SIAM Student Chapter Seminar: Difference between revisions

From DEV UW-Math Wiki
Jump to navigation Jump to search
No edit summary
 
(204 intermediate revisions by 11 users not shown)
Line 1: Line 1:
__NOTOC__
__NOTOC__


*'''When:''' Fridays at 1 PM unless noted otherwise
*'''Where:''' 9th floor lounge (we will also broadcast the virtual talks on the 9th floor lounge with refreshments)
*'''Organizers:''' Yahui Qu, Peiyi Chen and Zaidan Wu
*'''Faculty advisers:''' [http://www.math.wisc.edu/~jeanluc/ Jean-Luc Thiffeault], [http://pages.cs.wisc.edu/~swright/ Steve Wright]
*'''To join the SIAM Chapter mailing list:''' email [mailto:siam-chapter+join@g-groups.wisc.edu siam-chapter+join@g-groups.wisc.edu].
*'''Zoom link:''' https://uwmadison.zoom.us/j/97976615799?pwd=U2xFSERIcnR6M1Y1czRmTjQ1bTFJQT09
*'''Passcode:  281031'''


== Fall 2024 ==


*'''When:''' Every Other Wednesday at 2:15 pm (except as otherwise indicated)
{| class="wikitable"
*'''Where:''' 901 Van Vleck Hall
|+
*'''Organizers:''' [http://www.math.wisc.edu/~ke/ Ke Chen]
!Date
*'''To join the SIAM Chapter mailing list:''' email [join-siam-chapter@lists.wisc.edu] website.
!Location
 
!Speaker
<br>
!Title
 
 
== Fall 2018  ==
 
{| cellpadding="8"
!align="left" | date
!align="left" | speaker
!align="left" | title
|-
|-
| Sept. 12
|10 AM 10/4
|[http://www.math.wisc.edu/~ke/ Ke Chen] (Math)
|Birge 346
|''[[#Sep 12: Ke Chen (Math)|Inverse Problem in Optical Tomography]]''
|Federica Ferrarese (University of Ferrara, Italy)
|Control plasma instabilities via an external magnetic field: deterministic and uncertain approaches
|-
|-
| Spet. 26 
|11 AM 10/18
|[http://www.math.wisc.edu/~kehlert/ Kurt Ehlert] (Math)
|9th floor
|''[[#Sept 26: Kurt Ehlert (Math)| How to bet when gambling]]''
|Martin Guerra (UW-Madison)
|Swarm-Based Gradient Descent Meets Simulated Annealing
|-
|-
| Oct. 10  
|12:30 PM 10/31
|[http://TBD Zachary Hansen] (Atmospheric and Oceanic Sciences)
|VV 901
|''[[#Oct 10: Zachary Hansen (Atmospheric and Oceanic Sciences)| Land-Ocean contrast in lightning  ]]''
|Chuanqi Zhang (University of Technology Sydney)
|Faster isomorphism testing of p-groups of Frattini class-2
|-
|-
| Oct. 24 
|11/8
|[http://TBD Xuezhou Zhang] (Computer Science)
|9th floor
|''[[#Oct 24: Xuezhou Zhang (Computer Science)|  An Optimal Control Approach to Sequential Machine Teaching  ]]''
|Borong Zhang (UW-Madison)
|Solving the Inverse Scattering Problem: Leveraging Symmetries for Machine Learning
|-
|-
| Nov. 7
|11/15
|[http://TBD Cancelled]
|9th floor
|''[[#Nov 7: Cancelled| ]]''
(zoom)
|Yantao Wu (Johns Hopkins University)
|Conditional Regression on Nonlinear Variable Model
|-
|-
| Nov. 21
|
|[http://TBD Cancelled due to Thanksgiving]
|
|''[[#Nov 21: Cancelled| ]]''
|
|
|-
|-
| Nov. 28
|
|[http://TBD Xiaowu Dai] (Statistics)
|
|''[[#Nov 28: Xiaowu Dai (Statistics)| Toward the Theoretical Understanding of Large-batch Training in Stochastic Gradient Descent  ]]''
|
|
|-
|-
|
|
|
|
|
|}
|}


==Abstracts==
'''October 4th, Federica Ferrarese (University of Ferrara, Italy)''': The study of the problem of plasma confinement in huge devices, such as for example Tokamaks and Stellarators, has attracted a lot of attention in recent years. Strong magnetic fields in these systems can lead to instabilities, resulting in vortex formation. Due to the extremely high temperatures in plasma fusion, physical materials cannot be used for confinement, necessitating the use of external magnetic fields to control plasma density. This approach involves studying the evolution of plasma, made up of numerous particles, using the Vlasov-Poisson equations. In the first part of the talk, the case without uncertainty is explored. Particle dynamics are simulated using the Particle-in-Cell (PIC) method, known for its ability to capture kinetic effects and self-consistent interactions. The goal is to derive an instantaneous feedback control that forces the plasma density to achieve a desired distribution. Various numerical experiments are presented to validate the results. In the second part, uncertainty is introduced into the system, leading to the development of a different control strategy. This method is designed to steer the plasma towards a desired configuration even in the presence of uncertainty. The presentation concludes with a comparison of the two control strategies, supported by various numerical experiments.


== Abstract ==
'''October 18th, Martin Guerra (UW-Madison)''': In generic non-convex optimization, one needs to be able to pull samples out of local optimal points to achieve global optimization. Two common strategies are deployed: adding stochasticity to samples such as Brownian motion, as is done in simulated annealing (SA), and employing a swarm of samples to explore the whole landscape, as is done in Swarm-Based Gradient Descent (SBGD). The two strategies have severe drawbacks but complement each other on their strengths. SA fails in the accuracy sense, i.e., finding the exact optimal point, but succeeds in always being able to get close, while SBGD fails in the probability sense, i.e., it has non-trivial probability to fail, but if succeeds, can find the exact optimal point. We propose to combine the strength of the two and develop a swarm-based stochastic gradient method with samples automatically adjusting their annealing. Using mean-field analysis and long-time behavior PDE tools, we can prove the method to succeed in both the accuracy sense and the probability sense. Numerical examples verify these theoretical findings.
 
=== Sep 12: Ke Chen (Math) ===
Inverse Problem in Optical Tomography
 
I will briefly talk about my researches on the inverse problems of radiative transfer equations, which is usually used as a model to describe the transport of neutrons or other particles in a certain media. Such inverse problems considers the following question: given the knowledge of multiple data collected at the boundary of the domain of interest, is it possible to reconstruct the optical property of the interior of media? In this talk, I will show you that stability of this problem is deteriorating as the Knudsen number is getter smaller. The talk will be introductory and anyone graduate is welcome to join us.
 
=== Sept 26: Kurt Ehlert (Math) ===
How to bet when gambling
 
When gambling, typically casinos have an edge. But sometimes we can gain an edge by counting cards or other means. And sometimes we have an edge in the biggest casino of all: the financial markets. When we do have an advantage, then we still need to decide how much to bet. Bet too little, and we leave money on the table. Bet too much, and we risk financial ruin. We will discuss the "Kelly criterion", which is a betting strategy that is optimal in many senses.
 
=== Oct 10: Zachary Hansen (Atmospheric and Oceanic Sciences) ===
Land-Ocean contrast in lightning
 
Land surfaces have orders of magnitude more lightning flashes than ocean surfaces. One explanation for this difference is that land surfaces may generate greater convective available potential energy (CAPE), which fuels stronger thunderstorms. Using a high resolution cloud-resolving atmospheric model, we test whether an island can produce stronger thunderstorms just by having a land-like surface. We find that the island alters the distribution of rainfall but does not produce stronger storms. An equilibrium state known as boundary layer quasi-equilibrium follows, and is explored in more detail.
 
=== Oct 24: Xuezhou Zhang (Computer Science) ===
An Optimal Control Approach to Sequential Machine Teaching
 
Given a sequential learning algorithm and a target model, sequential machine teaching aims to find the shortest training sequence to drive the learning algorithm to the target model. We present the first principled way to find such shortest training sequences. Our key insight is to formulate sequential machine teaching as a time-optimal control problem. This allows us to solve sequential teaching by leveraging key theoretical and computational tools developed over the past 60 years in the optimal control community. Specifically, we study the Pontryagin Maximum Principle, which yields a necessary condition for opti- mality of a training sequence. We present analytic, structural, and numerical implica- tions of this approach on a case study with a least-squares loss function and gradient de- scent learner. We compute optimal train- ing sequences for this problem, and although the sequences seem circuitous, we find that they can vastly outperform the best available heuristics for generating training sequences.
 
=== Nov 7: Cancelled ===
 
=== Nov 21: Cancelled ===


=== Nov 28: Xiaowu Dai (Statistics) ===
'''October 31st, Chuanqi Zhang''' (University of Technology Sydney): The finite group isomorphism problem asks to decide whether two finite groups of order N are isomorphic. Improving the classical $N^{O(\log N)}$-time algorithm for group isomorphism is a long-standing open problem. It is generally regarded that p-groups of class 2 and exponent p form a bottleneck case for group isomorphism in general. The recent breakthrough by Sun (STOC '23) presents an $N^{O((\log N)^{5/6})}$-time algorithm for this group class. Our work sharpens the key technical ingredients in Sun's algorithm and further improves Sun's result by presenting an $N^{\tilde O((\log N)^{1/2})}$-time algorithm for this group class. Besides, we also extend the result to the more general p-groups of Frattini class-2, which includes non-abelian 2-groups. In this talk, I will present the problem background and our main algorithm in detail, and introduce some connections with other research topics. For example, one intriguing connection is with the maximal and non-commutative ranks of matrix spaces, which have recently received considerable attention in algebraic complexity and computational invariant theory. Results from the theory of Tensor Isomorphism complexity class (Grochow--Qiao, SIAM J. Comput. '23) are utilized to simplify the algorithm and achieve the extension to p-groups of Frattini class-2.
Toward the Theoretical Understanding of Large-batch Training in Stochastic Gradient Descent


Stochastic gradient descent (SGD) is almost ubiquitously used for training nonconvex optimization tasks including deep neural networks. Recently, a hypothesis that "large batch SGD tends to converge to sharp minimizers of training function" has received increasing attention. We develop some new theory to give a justification of this hypothesis. In particular, we provide new properties of SGD in both finite-time and asymptotic regimes, with the tools from empirical processes and Partial Differential Equations. A connection between the stochasticity in SGD and the idea of smoothing splines in nonparametric statistics is also built. We include numerical experiments to corroborate these theoretical findings.
'''November 8th, Borong Zhang''' (UW-Madison): The inverse scattering problem—reconstructing the properties of an unknown medium by probing it with waves and measuring the medium's response at the boundary—is fundamental in physics and engineering. This talk will focus on how leveraging the symmetries inherent in this problem can significantly enhance machine learning methods for its solution. By incorporating these symmetries into both deterministic neural network architectures and probabilistic frameworks like diffusion models, we achieve more accurate and computationally efficient reconstructions. This symmetry-driven approach reduces the complexity of the models and improves their performance, illustrating how physical principles can inform and strengthen machine learning techniques. Applications demonstrating these benefits will be briefly discussed.  


'''November 15th, Yantao Wu''' (Johns Hopkins): We consider the problem of estimating the intrinsic structure of composite functions of the type $\mathbb{E} [Y|X] = f(\Pi_\gamma X) $ where $\Pi_\gamma:\mathbb{R}^d\to\mathbb{R}^1$ is the closest point projection operator onto some unknown smooth curve $\gamma: [0, L]\to \mathbb{R}^d$ and  $f: \mathbb{R}^1\to \mathbb{R}^1$ is some unknown  {\it link} function. This model is the generalization of the single-index model where $\mathbb{E}[Y|X]=f(\langle v, X\rangle)$ for some unknown {\it index} vector $v\in\mathbb{S}^{d-1}$. On the other hand, this model is a particular case of function composition model where $\mathbb{E}[Y|X] = f(g(x))$ for some unknown multivariate function $g:\mathbb{R}^d\to\mathbb{R}$. In this paper, we propose an algorithm based on conditional regression and show that under some assumptions restricting the complexity of curve $\gamma$, our algorithm can achieve the one-dimensional optimal minimax rate, plus a curve approximation error bounded by $\mathcal{O}(\sigma_\zeta^2)$. We also perform numerical tests to verify that our algorithm is robust, in the sense that even without some assumptions, the mean squared error can still achieve $\mathcal{O}(\sigma_\zeta^2)$.


<br>
==Past Semesters==
*[https://wiki.math.wisc.edu/index.php/SIAM_Spring_2024 Spring 2024]
*[[SIAM Fall 2023|Fall 2023]]
*[[SIAM Spring 2023|Spring 2023]]
*[[SIAM Seminar Fall 2022|Fall 2022]]
*[[Spring 2022 SIAM|Spring 2022]]
*[[SIAM Student Chapter Seminar/Fall2021|Fall 2021]]
*[[SIAM_Student_Chapter_Seminar/Fall2020|Fall 2020]]
*[[SIAM_Student_Chapter_Seminar/Spring2020|Spring 2020]]
*[[SIAM_Student_Chapter_Seminar/Fall2019|Fall 2019]]
*[[SIAM_Student_Chapter_Seminar/Fall2018|Fall 2018]]
*[[SIAM_Student_Chapter_Seminar/Spring2017|Spring 2017]]

Latest revision as of 22:40, 13 November 2024


Fall 2024

Date Location Speaker Title
10 AM 10/4 Birge 346 Federica Ferrarese (University of Ferrara, Italy) Control plasma instabilities via an external magnetic field: deterministic and uncertain approaches
11 AM 10/18 9th floor Martin Guerra (UW-Madison) Swarm-Based Gradient Descent Meets Simulated Annealing
12:30 PM 10/31 VV 901 Chuanqi Zhang (University of Technology Sydney) Faster isomorphism testing of p-groups of Frattini class-2
11/8 9th floor Borong Zhang (UW-Madison) Solving the Inverse Scattering Problem: Leveraging Symmetries for Machine Learning
11/15 9th floor

(zoom)

Yantao Wu (Johns Hopkins University) Conditional Regression on Nonlinear Variable Model

Abstracts

October 4th, Federica Ferrarese (University of Ferrara, Italy): The study of the problem of plasma confinement in huge devices, such as for example Tokamaks and Stellarators, has attracted a lot of attention in recent years. Strong magnetic fields in these systems can lead to instabilities, resulting in vortex formation. Due to the extremely high temperatures in plasma fusion, physical materials cannot be used for confinement, necessitating the use of external magnetic fields to control plasma density. This approach involves studying the evolution of plasma, made up of numerous particles, using the Vlasov-Poisson equations. In the first part of the talk, the case without uncertainty is explored. Particle dynamics are simulated using the Particle-in-Cell (PIC) method, known for its ability to capture kinetic effects and self-consistent interactions. The goal is to derive an instantaneous feedback control that forces the plasma density to achieve a desired distribution. Various numerical experiments are presented to validate the results. In the second part, uncertainty is introduced into the system, leading to the development of a different control strategy. This method is designed to steer the plasma towards a desired configuration even in the presence of uncertainty. The presentation concludes with a comparison of the two control strategies, supported by various numerical experiments.

October 18th, Martin Guerra (UW-Madison): In generic non-convex optimization, one needs to be able to pull samples out of local optimal points to achieve global optimization. Two common strategies are deployed: adding stochasticity to samples such as Brownian motion, as is done in simulated annealing (SA), and employing a swarm of samples to explore the whole landscape, as is done in Swarm-Based Gradient Descent (SBGD). The two strategies have severe drawbacks but complement each other on their strengths. SA fails in the accuracy sense, i.e., finding the exact optimal point, but succeeds in always being able to get close, while SBGD fails in the probability sense, i.e., it has non-trivial probability to fail, but if succeeds, can find the exact optimal point. We propose to combine the strength of the two and develop a swarm-based stochastic gradient method with samples automatically adjusting their annealing. Using mean-field analysis and long-time behavior PDE tools, we can prove the method to succeed in both the accuracy sense and the probability sense. Numerical examples verify these theoretical findings.

October 31st, Chuanqi Zhang (University of Technology Sydney): The finite group isomorphism problem asks to decide whether two finite groups of order N are isomorphic. Improving the classical $N^{O(\log N)}$-time algorithm for group isomorphism is a long-standing open problem. It is generally regarded that p-groups of class 2 and exponent p form a bottleneck case for group isomorphism in general. The recent breakthrough by Sun (STOC '23) presents an $N^{O((\log N)^{5/6})}$-time algorithm for this group class. Our work sharpens the key technical ingredients in Sun's algorithm and further improves Sun's result by presenting an $N^{\tilde O((\log N)^{1/2})}$-time algorithm for this group class. Besides, we also extend the result to the more general p-groups of Frattini class-2, which includes non-abelian 2-groups. In this talk, I will present the problem background and our main algorithm in detail, and introduce some connections with other research topics. For example, one intriguing connection is with the maximal and non-commutative ranks of matrix spaces, which have recently received considerable attention in algebraic complexity and computational invariant theory. Results from the theory of Tensor Isomorphism complexity class (Grochow--Qiao, SIAM J. Comput. '23) are utilized to simplify the algorithm and achieve the extension to p-groups of Frattini class-2.

November 8th, Borong Zhang (UW-Madison): The inverse scattering problem—reconstructing the properties of an unknown medium by probing it with waves and measuring the medium's response at the boundary—is fundamental in physics and engineering. This talk will focus on how leveraging the symmetries inherent in this problem can significantly enhance machine learning methods for its solution. By incorporating these symmetries into both deterministic neural network architectures and probabilistic frameworks like diffusion models, we achieve more accurate and computationally efficient reconstructions. This symmetry-driven approach reduces the complexity of the models and improves their performance, illustrating how physical principles can inform and strengthen machine learning techniques. Applications demonstrating these benefits will be briefly discussed.

November 15th, Yantao Wu (Johns Hopkins): We consider the problem of estimating the intrinsic structure of composite functions of the type $\mathbb{E} [Y|X] = f(\Pi_\gamma X) $ where $\Pi_\gamma:\mathbb{R}^d\to\mathbb{R}^1$ is the closest point projection operator onto some unknown smooth curve $\gamma: [0, L]\to \mathbb{R}^d$ and  $f: \mathbb{R}^1\to \mathbb{R}^1$ is some unknown  {\it link} function. This model is the generalization of the single-index model where $\mathbb{E}[Y|X]=f(\langle v, X\rangle)$ for some unknown {\it index} vector $v\in\mathbb{S}^{d-1}$. On the other hand, this model is a particular case of function composition model where $\mathbb{E}[Y|X] = f(g(x))$ for some unknown multivariate function $g:\mathbb{R}^d\to\mathbb{R}$. In this paper, we propose an algorithm based on conditional regression and show that under some assumptions restricting the complexity of curve $\gamma$, our algorithm can achieve the one-dimensional optimal minimax rate, plus a curve approximation error bounded by $\mathcal{O}(\sigma_\zeta^2)$. We also perform numerical tests to verify that our algorithm is robust, in the sense that even without some assumptions, the mean squared error can still achieve $\mathcal{O}(\sigma_\zeta^2)$.

Past Semesters