Recent & Upcoming Seminars

This paper begins with an innovative taxonomy of hallucination in the era of LLM and then delve into the factors contributing to hallucinations. Subsequently, it presents a thorough overview of hallucination detection methods and benchmarks

the paper modifies the architecture of the two of the most popular methods in self-supervised continual learning (CaSSLe and Kaizen) and applies them on time-serries data for human activity recognition.

Using transformer based variational autoencoder and Gumbrl-Softmax, TABCF produces counterdactuals the are not biased towards changing the continuous features more often than the categorical features.

This presentation discusses a case study for diabetes pateints with the help of Knowledge-Infused LLM-Powered Conversational Health Agent.

The paper shows that LLMs are decent zero-shot reasoners by simply adding “Let’s think step by step” before each answer. Experimental results demonstrate that the Zero-shot-CoT, using the same single prompt template, significantly outperforms zero-shot LLM performances on diverse benchmark reasoning tasks

Bayesian optimization provides a solution to finding optimal parameters efficiently, especially when dealing with functions where traditional gradient-based methods are infeasible. This technique begins with a probabilistic model (Gaussian process) that represents our uncertainty about the function. As data points are sampled, this model is updated, gradually refining our understanding. The acquisition function then guides the search, balancing between exploring uncertain regions and exploiting known promising areas. This structured, adaptive search enables efficient navigation through high-dimensional spaces, even when some variables are discrete or conditional. Key acquisition functions, such as the upper confidence bound and probability of improvement, are discussed to illustrate how Bayesian optimization outperforms simpler search strategies by integrating prior knowledge and sequential learning.

This paper proposes aa framework to reprogram an existing LLM to perform time series forecasting.

The paper addresses the limitations of recurrent neural networks (RNNs) in sequence transduction tasks, specifically their sequential nature hindering parallelization and efficiency, especially with long sequences. The authors aim to overcome these limitations and propose a novel architecture that can learn long-range dependencies more effectively.

This paper proposes a DAG-GNN based VAE to reflect the inter-feature relationships in the produced counterfactuals.

In this work, we introduce a framework for this optimization problem, mathematically formulate the minimum cost channel selection (MCCS), and propose two novel algorithms to solve the MCCS problem.

This presentation discusses the NLGraph benchmark, which was created to evaluate LLMs on graph problems.

A reinforcement learning approach to solve the vehicle routing problem.

This study aims to quantify the influence of various meal-related factors on predicting postprandial blood glucose levels (BGLs) at different time intervals (15 min, 60 min, and 120 min) after meals by using deep neural network (DNN) models.

This paper proposes a series of adaptations and enhancements around BERT to best work with IMU data in mobile sensing applications.

This paper study provides a novel contribution to the field of signal processing and DL for ECG signal analysis by introducing a new feature representation method for ECG signals.

DualNet is a state-of-the-art neural net architecture that uses the idea of self-supervised learning to learn general features of image data to prevent catastrophic forgetting.

The authors aimed to fit a simple mathematical model on dynamic postprandial glucose data from repeated MMTTs among participants with elevated T2DM risk to identify response clusters and investigate their association with T2DM risk factors and gut microbiota.

This paper introduces a technique to produce synthetic counterfactual images to train a model free of bias.

This presentation discusses label-free tunning of zero-shot classifiers using language and unlabeled image collections.

In this paper, the authors introduce Random Erasing, a new data augmentation method for training the convolutional neural network (CNN). In training, Random Erasing randomly selects a rectangle region in an image and erases its pixels with random values.

In this work, the authors present self-supervision strategies that can be used to learn informative representations from multivariate time series.

This paper proposes Health-LLM, a framework in the healthcare domain that aims to bridge the gap between pre-trained knowledge in current LLMs and consumer health problems.

This study leveraged advances in continuous glucose monitoring (CGM) and cognitive ecological momentary assessment (EMA) to characterize dynamic, within-person associations between glucose and cognition in naturalistic environments.

This presentation discusses a new way to encrypt data with the help of LLMs.

In this work, the authors revisit the most fundamental building block in deep learning, the multi-layer perceptron (MLP), and study the limits of its performance on vision tasks.

CountER tells us under what conditions a chosen item would not be recommended to a person anymore.

This paper presents a framework for learning representations from EEG signals via contrastive learning.

This paper presents a robotic object hitting task to quantify sensorimotor impairments in participants with stroke

This presentation introduced the latest AI assistance from Meta company.

This presentation presents self-supervised method that learns invariant representations rather than covariant ones.

This paper proposes a framework for better understanding what is happening behind the training of over-parameterized neural nets, for which the objective function is not convex, not even locally

Adversarial Counterfactual Explanations propose to develop a filter that robustifies a model against adversarial attacks and helps to transform them into counterfactual explanations.

This presentation discusses solving complex AI tasks with a new model named HuggingGPT.

This paper proposes a contrastive learning based approach to solve the problem of causal representation learning, under the assumption of linear-gaussian representation, and a non-linear mixing function

In this paper, the authors present a network and training strategy that relies on the strong use of data augmentation to use the available annotated samples more efficiently.

This paper proposes a novel approach for learning such representations from multi-channel EEG time-series, and demonstrate its advantages in the context of mental load classification task.

This presentation presents semi-supervised neural network for freezing of gait classification.

This presentation aims understanding the relationship between HbA1c and brain health across the entire glycaemic spectrum.

CounterNet proposes an end-to-end training of the predictor and explanation generator to solve some key issues associated with post-hoc/model agnostic explainers.

This presentation discusses missing data imputation through fuzzy c-means clustering.

This paper proposes a new self-supervised learning based approach for industrial time-series analysis which uses data-augmentation techniques

This paper proposes two binary imbalanced data classification methods with extreme learning machine autoencoders and generative models. Their methods outperform SMOTE and similar data balancing tools on most benchmark datasets.

This presentation describes and explains Fourier Transform, Short-Time Fourier Transform, and Wavelet Transform.

In this paper, various data augmentation methods for wearable sensor data are proposed. The proposed methods and CNNs are applied to the classification of the motor state of Parkinson’s Disease patients.

inability to recognize counterrfactual diagnosis from associative diagnosis can lead to disastrous outcomes.

This article demonstrate a new approach to implement counterfactual explanations (CE) without necessarily employing any generative model. As generative models come with several drawbacks in CE generation, the approach in this paper is based on Epistemic and Aleatoric Uncertainty reduction.

This paper discusses the available methods to detect change points in time-series data.

This paper presents SimCLR, a simple framework for contrastive learning of visual representations.

A brief introduction to causality with the emphasis on the book “The Book of Why”, by Judea Pearl.

This article focuses on defining what counterfactuals mean in the context of timeseries data and proposed an algorithm that generates plausible and minimally distant counterfactual explanations.

A fundamental limitation of applying semi-supervised learning in real-world settings is the assumption that unlabeled test data contains only classes previously encountered in the labeled training data. However, this assumption rarely holds for data in-the-wild, where instances belonging to novel classes may appear at testing time. Here, we introduce a novel open-world semi-supervised learning setting that formalizes the notion that novel classes may appear in the unlabeled test data.

Conducting a causal inference study with observational data is a difficult endeavor that necessitates a slew of assumptions. One of the most common assumptions is “ignorability,” which argues that given a patient (X), the pair of outcomes (Y0, Y1) is independent of the actual treatment received (T). This assumption is used in this paper to develop an AI model for calculating the Average Treatment Effect (ATE).

An introduction to counterfactual explanations using the novel approach developed by Microsoft Corporation, India.

In this position paper, the authors define interpretability and describe when interpretability is needed (and when it is not). Next, they suggest a taxonomy for rigorous evaluation and expose open questions towards a more rigorous science of interpretable machine learning.

Propensity score is the probability of a patient receiving the treatment. Given the propensity score, the covariates are independent from the treatment variable. Therefore, it can be used to turn an observational data into a data collected using a randomized trial. This paper talks about different methods of applying propensity scores to causal studies.

This study implemented SimCLR on EHR data to detect rare dseases. In general, rare diseases are underrepresentative classes in any clinical dataset. Therefore, using SimCLR (contrastive learning) boosts their classification accuracy.

We propose an automated risk prediction system that can make recommendations to clinicians in real-time with machine learning classifiers that predict the risk of developing neurological impairment.

Neural ODEs describe a flow from the input to the output. They utilize the traditional ODE solvers to reach this goal. By doing so, they introduce a trade-off between accuracy and computational cost.

This paper reduces drug-drug interaction in automated medication recommendation with help of self-supervised adversarial distribution regularization

TIME is a great tool for explaining the predictions made by a model. It is very similar to Grad-CAM, however, it can work with tabular data as well. Also, TIME can provide global expainability as well.

This study used machine learning methods to identify and detect the moments of cannabis use in participants. The model was trained using a leave-one-subject-out method, and later personalized using transfer learning

This research paper aims at building an entropy layer for end-to-end explainable AI framework. Unlike LIME and Grad-CAM, Entropy Net does not rely on any auxuliary tool/model to explain its predictions. Also, Entropy Net focuses on downsizing the concepts required to explain predictions.

This research aimed to develop a lifestyle intervention system with an emphasis on time series forecasting and also to develop a generic multimodal activity forecasting scheme that can be used with either early fusion or late fusion mechanisms.

REP-Net is a counter to traditional transfer learning for On-board model training with more focus on memory efficiency.

TDragonnet is an end-to-end neural network architecture that uses propensity score to estimate the average treatment effect.

This paper provides an overview of basic and advanced approaches of time-series data augmentation.

Training GANs require large amount of data. If tried with small datasets, the discriminator often times overfit producing meaningless feedback to the generator. One solution to training GANs with smaller dta could be using adaptive data augmentation.

This paper proposes GPT-3, an autoregressive language model with 175 billion parameters, 10x more than any previous non-sparse language model, and test its performance in the few-shot setting.

Including domain knowledge can increase explainability without compromising on model performance. This paper mainly discusses a preprocessing technique to incorporate domain knowledge in a way they become very useful for explaining model’s predictions.

This paper proposes a new deep learning framework for irregularly sampled time-series data that is called Multi-Time Attention Networks.

This paper shows that masked autoencoders (MAE) are scalable self-supervised learners for computer vision.

Incorporating domain knowledge to neural networks is a creative and case specific approach. This paper modifies the loss function of a fully-connected network with domain knowledge from kinetics which helped the model make precise prediction in its regression task.

An algorithm for meta-learning that is model-agnostic, in the sense that it is compatible with any model trained with gradient descent and applicable to a variety of different learning problems, including classification, regression, and reinforcement learning.

Prelim Exam Practice Presentation of Ramesh Sah.

A reinforcement learning approach to solve the vehicle routing problem.

Optimizes change in consumed nutrients while driving users to their desired diet.

Practice presentation for Master defense of Ramesh Sah.

This paper proposes a new channel pruning method based on artificial bee colony algorithm (ABC), dubbed as ABCPruner, which aims to efficiently find optimal pruned structure.

LIME is a great tool for explaining the predictions made by a model. LIME can explain any model regardless of their type, it works by building a linear model on vicinity of the sample intended to be explained.

This paper addresses the generalization gap on large neural networks with adaptive gradient-based optimizers and proposes a partially adaptive solution to overcome the problem.

In this talk, we present and discuss different strategies for data augmentation.

Decision boundaries are imposible to be visualized in hogh dimensional feature sets. Instead of visualizing them, we can characterize them and make them useful

We focus on devising algorithms that combine data about physical activity and engagement with the app to predict future physical activity performance.

In this talk, Ramesh explained and highlighted different methods to deal with imbalanced dataset. He shared his experience working with imbalance datasets and partical tips and tricks.

Neural networks have a bad reputations as they are treated like black boxes and lack interpretations on the results they make. Grad-CAM can slightly interprete what is driving the model to make a decision.

Enhancement of accuracy for wrist-worn sensor based lying posture classification via transfer learning

Optimization Algorithms to begin with Sparse Coding.

Continous detection of stress using external heart rate monitor to drive inter beat interval feature on a smartphone.

Introduction to variational autoencoders.

Techniques for training GANs using Semi-supervised learning.

Examine the relationship between stress and physical activity and healthy eating in both direction - negative and positive - using ecological momentary assessment (EMA).

A novel framework called SubNetwork Routing (SNR) to achieve more flexible parameter sharing while maintaining the computational advantage of the classic multi-task neural-network model.

Introduction to binary neural networks with details about training and evaluation of these networks.

Introduction to the statistical learning theory, and a prelude to PAC learning

Adding Online-Learning ability to TinyML.

Review of the “Any-Width Networks” from CVPR 2020 workshops.

How does the brain prevent interference of memory and sensory data?

Emotion classification using self-supervised learning and six signal transformations as pretext tasks.

Review of the paper “Attention Is All You Need”

Review of the recent research on bringing the transformer architecture to the computer vision field.

Quantifying user burden for EMA studies with frequent and one-question EMA assessment.

Review of the AI Economist paper by Salesforce Research.

Overview of two visions systems by Open AI

Picking phase and detecting earthquakes using encoder-decoder transformer model.

Review of ICLR'18 paper by Novak et.al.

Understanding why transfer learning is successful

Practical tips for researchers for managing ML experiments

General high-level introduction to Gaussian Processes for time-series data modelling.

Introduction to neural tangent kernel

Review of self-supervised learning for human activity recognition

Review of The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks

Re-presentation of Yann LeCun’s AAAI talk and discussion on semi-supervised learning methods.

Paper Review: Elsayed, G.F., Goodfellow, I.J., & Sohl-Dickstein, J. (2019). Adversarial Reprogramming of Neural Networks. ICLR.

Paper Review: Kornblith, S., Norouzi, M., Lee, H., & Hinton, G.E. (2019). Similarity of Neural Network Representations Revisited. ICML

An introduction to Differential Privacy and Federated Learning concepts.

Practice presentation for SMARTCOMP conference.