Predicting Material Structures and Properties Using Deep Learning and Machine Learning Algorithms

Wednesday, June 7, 2023 - 11:00 am
Online

DISSERTATION DEFENSE 
Author : Yuqi Song

Advisor : Dr. Jianjun Hu

Date : June 7, 2023

Time:  11 - 12:30 pm 

Place : Virtual

Meeting Link : https://us04web.zoom.us/j/6926040413?pwd=Ab5_mUtciTlbxlZr0Lmx1ktxIi75VK.1

Abstract 

Discovering new materials and understanding their crystal structures and chemical properties are critical tasks in the material sciences. Although computational methodologies such as Density Functional Theory (DFT), provide a convenient means for calculating certain properties of materials or predicting crystal structures when combined with search algorithms, DFT is computationally too demanding for structure prediction and property calculation for most material families, especially for those materials with a large number of atoms. This dissertation aims to address this limitation by developing novel deep learning and machine learning algorithms for the effective prediction of material crystal structures and properties. Our data-driven machine learning modeling approaches allow to learn both explicit and implicit chemical and geometric knowledge in terms of patterns and constraints from known materials and then exploit them for efficient sampling in crystal structure prediction and feature extraction for material property prediction.

 

In the first topic, we present DeltaCrystal, a new deep learning based method for crystal structure prediction. This data-driven algorithm learns and exploits the abundant atom interaction distribution of known crystal material structures to achieve efficient structure search. It first learns to predict the atomic distance matrix for a given material composition based on a deep residual neural network and then employs this matrix to reconstruct its 3D crystal structure using a genetic algorithm. Through extensive experiments, we demonstrate that our model can learn the implicit inter-atomic relationships and its effectiveness and reliability in exploiting such information for crystal structure prediction. Compared to the global optimization based CSP method, our algorithm achieves better structure prediction performance for more complex crystals.

 

In the second topic, we shift our focus from individually predicting the positions of atoms in each material structure to the idea of crystal structure prediction based on structural polyhedron motifs based on the observation that these atom patterns appear frequently across different crystal materials with high geometric conservation, which has the potential to significantly reduce the search complexity. We extract a large set of structural motifs from a vast collection of material structures. Through the comprehensive analysis of motifs, we uncover common patterns and motifs that span across different materials. Our work represents a preliminary step in the exploration of material structures from the motif point of view and exploiting such motifs for efficient crystal structure prediction.

 

In the third topic, we propose a machine learning based framework for discovering new hypothetical 2D materials. It first trains a deep learning generative model for material composition generation and trains a random forest-based 2D materials classifier to screen out potential 2D material compositions. Then, a template-based element substitution structure prediction approach is developed to predict the crystal structures for a subset of the newly predicted hypothetical 2D formulas, which allows us to confirm their structural stability using DFT calculations. So far, we have predicted 101 crystal structures and confirmed 92 2D/layered materials by DFT formation energy calculation.

 

In the last topic, we focus on machine learning models for predicting material properties, including piezoelectric coefficients and noncentrosymmetricity of nonlinear optical materials, as they play important roles in many important applications, such as laser technology and X-ray shutters. We conduct a comprehensive study on developing advanced machine learning models and evaluating their performance for predicting piezoelectric modulus from materials' composition/structures. Next, we train several prediction models based on extensive feature engineering combined with machine learning models and automated feature learning based on deep graph neural networks. We use the best model to predict the piezoelectric coefficients for 12,680 materials and report the top 20 potential high-performance piezoelectric materials. Similarly, we develop machine learning models to screen potential noncentrosymmetric materials from 2,000,000 hypothetical materials generated by our material composition generative design model and report the top 80 candidate noncentrosymmetric nonlinear materials.

Extending The Convolution In Graph Neural Networks To Solve Materials Science And Node Classification Problems

Tuesday, May 2, 2023 - 01:00 pm
online

DISSERTATION DEFENSE 

Author : Steph-Yves Louis

Advisor : Dr. Jianjun Hu

Date : May 2nd

Time:  1 - 3 pm 

Place : Virtual

Meeting Link : https://us06web.zoom.us/j/83309917826?pwd=eFdBM2h3YWRmbjJUYUdJMzRUOEFmQ…

Abstract 

The usage of graph to represent one's data in machine learning has grown in popularity in both academia and the industry due to its inherent benefits. With its flexible nature and immediate translation to real life observed objects, graph representation had a considerable contribution in advancing the state-of-the-art performance of machine learning in materials.

In this dissertation, we discuss how machines can learn from graph encoded data and provide excellent results through graph neural networks (GNN). Notably, we focus our adaptation of graph neural networks on three tasks: predicting crystal materials properties, nullifying the negative impact of inferior graph node points when learning, and generating crystal structures from material formula. In the first topic, we propose and evaluate a molecule-appropriate adaptation of the original graph-attention (GAT) model for materials property prediction. With the changes of including the encoded bonds formed by atomic elements and adding a final global-attention layer, our experiments show that our approach (GATGNN) achieves great performance and provides interpretable explanation of each atom.

For the second topic, we analyze the learning process of various well-known GNNs and identify a common issue of propagating noisy information. Aiming to reduce the spread of particularly harmful information, we propose a simple, memory-efficient, and highly scalable method called NODE-SELECT. Our results demonstrate that the combination of hard attention coefficients, binary learnable selection parameter, and v parallel arrangement of the layers significantly reduce the negative impact of noise data propagation within a GNN.

In the third topic, we extend the development of our GATGNN method and apply it to simulate electrodes reaction for predicting voltages. Finally, in our last topic, we propose a conditional generative method, named StructR-Diffusion for generating crystal structures. In this approach, we employ both GNN, stable diffusion, and graph-transformers to learn 3-dimentional space positioning of the elements within a unit-vector. Various statistical tests, physical attribute predictions, and visual inspections show that our proposed graph convolutional network model has a good generative capability. Our efficient model proves that it can generate diverse structures that are optimized even prior to DFT relaxations.

Restricted Eavesdropping Analysis in Quantum Cryptography

Friday, April 28, 2023 - 10:15 am
online

Restricted Eavesdropping Analysis in Quantum CryptographyAbstract: Quantum computing is a fast developing field, but it poses threats to the modern cryptography system, thus research in quantum cryptography is of great importance for near-term applications. However, traditional security analysis assumes that the eavesdropper is omnipotent, with her "abilities" only limited by the laws of quantum physics. In this research talk I will introduce my work on "Geometrical Optics Restricted Eavesdropping Analysis of Secret Key Distillation and its applications to practical scenarios", which extended traditional secret key distillation security analysis scheme to a more realistic scenario where the eavesdropper is assumed with a limited power collection ability. Such a restricted-eavesdropping scenario is highly applicable on wireless communication links like wireless microwave or free space optics communications. We will start from a quantum wiretap channel to establish lower bounds and upper bounds based on Hashing Inequality and Relative Entropy of Entanglement. We will then apply this model to realistic channel conditions and analyze eavesdropping and defense strategies from both the eavesdropper's and communication parties' sides. Respective conclusions will be presented and discussed in detail during the presentation.

Ziwen Pan is currently a wireless systems applications engineer, mainly working with auto-testing solutions for Qualcomm chipsets on technologies such as WiFi, BT, GPS, etc. He obtained his Ph.D. degree at the Electrical & Computer Engineering department from the University of Arizona in 2022. His major research work focuses on quantum communication/cryptography, including security analysis of generic secret key distillation schemes and protocol designs for quantum key distributions. He has also worked on other projects such as quantum computation simulation and experimental work on diamond oscillator arrays and microtoroids, FPGA-embedded LDPC channel coding, and entanglement-assisted communication protocol design. He has published in and served as a reviewer for multiple IEEE, Optica (OSA), and APS journals.

Click here to join the meeting

Meeting ID: 221 306 098 190
Passcode: yGeRKj

Designing Quantum Programming Languages with Types

Wednesday, April 26, 2023 - 10:15 am
online

Quantum computing presents many challenges for the programming language community. How can we program quantum algorithms in a way that ensures they behave correctly? In this talk, I will explore how types can be used to enforce various properties of quantum programs. I will highlight my research on combining linear types and dependent ttypes to create more expressive type systems for quantum programming languages. I will also discuss my work on dynamic lifting, which is a construct in Quipper/Proto-Quipper that enables programming quantum algorithms such as magic state distillation and the repeat-until-success paradigm.

Bio: Dr. Frank (Peng) Fu is a postdoctoral researcher at Dalhousie University. He received his Ph.D. from University of Iowa in 2014. His research interests  include type theory, the design and implementation of quantum programming languages. He has served on program committees for international conferences such as FSCD and PLanQC.

 

Click here to join the meeting

Meeting ID: 241 582 962 702 Passcode: ytidHn

Learning Efficiently and Robustly in Data-Scarce Regimes

Friday, April 21, 2023 - 01:00 pm
online

AIISC Seminar (Invited Talk)

Zoom: https://us06web.zoom.us/j/8440139296?pwd=b09lRCtJR0FCTWcyeGtCVVlUMDNKQT…

The unprecedented processing demand, posed by the explosion of big data, challenges researchers to design efficient and adaptive machine learning algorithms that do not require persistent retraining and data annotation and avoid learning redundant information. This capability is essential in adopting AI in healthcare and biomedical applications. Inspired by learning techniques of intelligent biological agents, identifying transferable knowledge across learning problems has been a significant research focus to improve machine learning algorithms. Towards this mission, this talk covers how the challenges of knowledge transfer can be addressed through embedding spaces that capture and store hierarchical knowledge.We first focus on the problem of cross-domain knowledge transfer and show how this idea can address the challenges of learning with unannotated data, including, in medical image segmentation.We then investigate the problem of cross-task knowledge transfer in sequential learning settings. Here, the goal is to identify relations and similarities of multiple machine learning tasks to improve performance across tasks that are encountered temporally one at a time. We show how the core idea can help to address catastrophic forgetting and learning from distributed private data.Finally, we focus on potential and new research directions to expand past results.

About the Speaker: Mohammad Rostami is a faculty member at the USC Department of Computer Science with a joint appointment at the Department of Electrical and Computer Engineering. He is alsoa research leadat the USC Information Sciences Institute. Before USC, he received his PhD from the University of Pennsylvania, where he was awarded the Joseph D'16 and Rosaline Wolf Best PhD Dissertation Award. His research focus is on machine learning in data scarce regimes, focusing on practical applications in healthcare.His research has been recognized by several awards, including, IJCAI Distinguished Student Paper Award, AAAI New Faculty Highlights, and Keston Research Award. More at: https://viterbi.usc.edu/directory/faculty/Rostami/Mohammad

Challenges and Opportunities in Quantum Networks

Tuesday, April 18, 2023 - 10:00 am
online

Abstract:   The vision of a quantum Internet, a global network capable of transmitting quantum information, brings with it the promise of implementing quantum applications such as quantum key distribution (QKD), quantum computation, quantum sensing, clock synchronization, quantum-enhanced measurements, and many others. Developing such an infrastructure needs to address major challenges, such as channel and operational noise, limited quantum information lifetime, and long-distance transmission losses. In this talk, I will present my work that tackles these major challenges and designs performance benchmarks, architectures, and resource allocation policies for first-generation quantum networks.

Bio:  Dr. Nitish Kumar Panigrahy is currently a postdoctoral researcher at NSF ERC Center for Quantum Networks, working jointly with Prof. Leandros Tassiulas (Yale University) and Prof. Don Towsley (University of Massachusetts Amherst). He earned his Ph.D. degree in Computer Science at the University of Massachusetts Amherst in 2021. Nitish’s research interests lie in modeling, optimization, and performance evaluation of networked systems with applications to the Internet of Things (IoT), cloud computing, content delivery, and quantum information networking.


Join Zoom Meeting
https://us02web.zoom.us/j/83481962243?pwd=R3FCMCtLdWFhSmtPeCtyU1NseDIwd…

Meeting ID: 834 8196 2243
Passcode: 612005

CSE Research Symposium

Friday, April 14, 2023 - 11:30 am
550 Assembly St, Room 2277

Graduate students will be selected by their advisor to present a research poster. Monetary awards will be given to the top 3 posters.

Agenda

Time Location Event
11:30 am – 12:45 pm

Room 2277

(If no seating is available in room 2277, please visit rooms 2265, 2267 and 2268)

Networking and refreshments
12:45 pm – 2:00 pm 2nd floor hallway Graduate student poster session
2:00 pm – 2:15 pm Break
2:15 pm – 4:00 pm Room 1400 (1st floor) 7 Minute Madness
4:00 pm – 4:20 pm Room 1400 (1st floor) Closing Notes and Poster Awards

 

Poster Session Authors

Poster Number Advisor Name Poster Title
1 Amit Sheth Towards Rare Event Prediction in Manufacturing Domain
2 Amit Sheth Alleviate: Artificial Intelligence Enabled Virtual Assistance for Telehealth: The Mental Health Case
3 Amit Sheth FACTIFY3M - A benchmark for multimodal fact verification with explainability through 5W Question-Answering
4 Amit Sheth and Forest Agostinelli Inductive Logic Programming for Explainable Artificial Intelligence
5 Biplav Srivastava Rating of AI Systems Through a Causal Lens
6 Biplav Srivastava Group Recommendation and a Case Study in Team Formation with ULTRA
7 Biplav Srivastava Planner Performance Improvement using Ontology
8 Chin-Tser Huang Smarkchain: An Amendable and Correctable Blockchain Based on Smart Markers
9 Chin-Tser Huang Investigation of 5G and 4G V2V Communication Channel Performance Under Severe Weather
10 Christian O'Reilly Deep Ensemble Learning: A Synergistic Approach for Ultrasonic Vocalization Analysis in Post-Traumatic Stress Disorder Study
11 Christian O'Reilly Characteristics of cerebrospinal fluid in Autism Spectrum Disorder (ASD): A systematic review
12 Christian O'Reilly and Amit Sheth Interpretable Machine Learning for Predicting the Likelihood of Autism from Infant ECG Recordings​​
13 Forest Agostinelli Explainable AI for Solving Pathfinding Problems through Collaborative Education
14 Ioannis Rekleitis SM/VIO: Robust Underwater State Estimation Switching Between Model-based and Visual Inertial Odometry
15 Ioannis Rekleitis Confined Water Body Coverage under Resource Constraints
16 Ioannis Rekleitis Weakly Supervised Caveline Detection For AUV Navigation Inside
Underwater Caves
17 Jianjun Hu crystalTransformer
18 Jianjun Hu Composition based Oxidation State Prediction of Materials using Deep Learning Language Model
19 Jianjun Hu DeepXRD, a Deep Learning Model for Predicting XRD spectrum from Material Composition
20 Jianjun Hu Scalable deeper graph neural networks for high-performance materials property prediction
21 Pooyan Jamshidi Partitioning and Mapping for ASIC AI Accelerators
22 Pooyan Jamshidi Not Just a Rose by Any Other Name: Differential Privacy as an Instrumentality of Effective Regulation Thwarting the Subterfuge of Differential Privacy by another Name and Undue Influence
23 Qi Zhang, Christopher Sutton Maximizing Learning Efficiency in Material Science through Domain Adaptation
24 Ramtin Zand Reliability-Aware Deployment of DNNs on In-Memory Analog Computing Architectures
25 Sanjib Sur MatGAN: Sleep Posture Imaging using Millimeter-Wave Devices
26 Sanjib Sur Towards Robust Pedestrian Detection with Roadside Millimeter-Wave Infrastructure
27 Sanjib Sur Outdoor Millimeter-Wave Picocell Placement using Drone-based Surveying and Machine Learning
28 Sanjib Sur Outdoor Small Scale Point Cloud Reconstruction Using Drone-based Millimeter-Wave FMCW Radar System and CFAR
29 Sanjib Sur MmSight: Millimeter-Wave Imaging on 5G Handheld Smart Devices
30 Sanjib Sur Enabling Integrated Networking and Activity Sensing in Indoor Millimeter-Wave Networks
31 Sanjib Sur mmWaveNet: Indoor Point Cloud Generation from Millimeter-Wave Devices
32 Sanjib Sur, Srihari Nelakuditi SSCense: A Millimeter-Wave Sensing Approach for Estimating Soluble Sugar Content of Fruits
33 Song Wang Few-shot 3D Point Cloud Semantic Segmentation via Stratified Class-specific Attention Based Transformer Network
34 Song Wang Parametric Surface Constrained Upsampler Network for Point Cloud
35 Song Wang MISF: Multi-level Interactive Siamese Filtering for High-Fidelity Image Inpainting
36 Stephen Fenner Implementing the fanout operations with simple pairwise interactions
37 Homayoun Valafar "Revolutionizing Cardiovascular Health: Harnessing the Power of Deep Learning for Automatic Calcification Calculation in Vascular Systems"
38 Homayoun Valafar Smartwatch-Based Smoking Detection Using Accelerometer Data and Neural Networks
39 Homayoun Valafar Analysis of cancer patients’ molecular and clinical data using Machine Learning approaches
40 Vignesh Narayanan On Safe and Usable Chatbots for Promoting Voter Participation
41 Vignesh Narayanan Building a Digital Twin for Information Environment
42 Yan Tong Unlocking the Potential of Consumer Wearables for Predicting Sleep in Children: A Device-Agnostic Machine Learning Approach
43 Yan Tong Cascade Feature Fusion Network for Facial Expression Recognition
44 Ramtin Zand Facial Expression Recognition at the edge: CPU vs GPU vs VPU vs TPU
45 Ramtin Zand Static American Sign Language Recognition Using Neuromorphic Hardware

 

7 Minute Madness

Number Time slot Speaker
1 2:15 – 2:22 Ramtin Zand
2 2:30 - 2:37 Pooyan Jamshidi
3 2:40 – 2:47 Sanjib Sur
4 2:50 – 2:57 Forest Agostinelli
5 3:00 – 3:07 Vignesh Narayanan
6 3:10 – 3:17 Ioannis Rekleitis
7 3:20 – 3:27 Song Wong (presented by Ping Ping cai)
8 3:30 – 3:37 Christian O’Reilly
9 3:40 – 3:47 Biplav Srivastava
10 3:50 – 3:57 Jianjun Hu
11 4:00 – 4:07 Yan Tong
12 4:10 – 4:17 Steve Fenner
13 4:20 – 4:27 Homayoun Valafar

 

Closing Notes and Poster Awards

4:30 – 4:45 Dr. Homayoun Valafar

Toward AI Augmented Healthcare

Tuesday, April 11, 2023 - 11:15 am
Innovation Center, 550 Assembly Street, Room 2277 (2nd floor)

Advances in artificial intelligence (AI) and the increasing digitization of healthcare data promise significant advances in disease understanding, therapeutic development, patient treatment and, ultimately, improvement in health outcomes. However, many technical and anthropological challenges must be addressed if AI is to fulfill this potential. In this talk, we will first discuss a conceptual framework for conducting AI based clinical decision support (CDS) research that includes qualitative research to understand clinician needs, AI method development and applications research, and aspects of implementation science to address barriers to system adoption. In the context of this framework, we will consider three research studies focused on AI utilization in healthcare applications: (1) development of a sepsis early warning system for neonatal intensive care units; (2) automated recognition of adverse event descriptions in social media and electronic health records (EHRs); and (3) subtyping of traumatic brain injury (TBI). For the sepsis study, we will discuss challenges related to AI systems that must continuously update predictions for patients including concerns over false alarm rate and model interpretability. Relative to adverse event detection, we will discuss natural language processing and deep learning methods. For TBI subtyping, we will see an application of unsupervised learning on EHR data and correlation between baseline subtypes and long-term outcomes. Along the way, we will discuss topics related to predictive model development, unsupervised learning, explainable AI, and the need for domain expert collaboration. Finally, we will discuss ideas for future directions for each of these studies.