I have been asked about this topic so many times during the past week that I decided to write it up here. Okay, last week there was some questionable conjecture about a hypothetical AI that supports an algorithm that is supposedly called “Q-*” or “Q-Star”. What could this mean? I…

Introduction The phenomenon of hallucinations in Large Language Models (LLMs) presents a unique challenge in the realm of artificial intelligence and machine learning. As researchers and developers seek to refine these models for more accurate and reliable outputs, understanding and addressing the issue of hallucinations becomes paramount. This blog post delves…

Text embeddings, also known as word embeddings, are high-dimensional, dense vector representations of text data that enable the measurement of semantic and syntactic similarity between different pieces of text. They are usually created by training machine learning models like Word2Vec, GloVe, or BERT on large amounts of text data. These…

Authors: Ali Arsanjani, Balazs Pinter, Google AI CoE Context / Background Vertex AI is a fully managed ML platform that provides all the tools and infrastructure you need to build, deploy, and scale ML models. It offers a wide range of features, including: Pre-trained models: Vertex AI offers a library of pre-trained models…

The evolution of large language models (LLMs) builds upon the foundations laid by two seminal papers in natural language processing (NLP): “Attention is All You Need” and the “word2vec” paper. These papers introduced key concepts and techniques that have shaped the development of LLMs. The paper “Attention is All You…

Part 1: Key Concepts and Workflows The common AI/ML Lifecycle consists of data collection, preparation, training, evaluation, deployment and monitoring all encompassed with an MLOps pipeline. Generative AI (GenAI) is a transformational technology that will continue its ramifications of major industry shifts in the coming months and years. Currently, in…

Ali Arsanjani, Edited, from a transcription and summary of a recent talk, in collaboration with Joel Milag, Wow AI and Team In this insightful session, Dr. Ali Arsanjani, Director of Cloud Partner Engineering at Google Cloud, discussed with the audience how to leverage AI/ML throughout the lifecycle to increase organizational…

How can Data/Analytics and AI/ML help with better business decision making? How can we unlock the potential in your data? Given a relatively volatile set of macroeconomic, socio-political and geographical (eg supply chain) business uncertainties on the one hand and the promise of technologies for and new possibilities, how can…

Using Amazon SageMaker Pipelines, Amazon Jumpstart Industry SDK and HuggingFace Transformers by Ali Arsanjani NLP Pipeline for Company Earnings Analysis In this series on end-to-end pipelines for MLOps, we will explore Natural Language Processing (NLP) pipelines. Previous post series have covered the tabular/numeric aspects of end-to-end MLOps automation of the ML Lifecycle for Fraud Detection and Music Recommendation.