DATA Pill #069 - is ELT dead? Chatbot with LLMs, DevOpsGPT

Hi,

We sense that summer is coming to an end... from the flurry of articles that have appeared over the last week. It was hard to choose the essence for today's ingestion. 

Such a mass of enthusiasm - the vacations must have been enjoyed 😎🌴🏄♂

Plenty of articles await you!

E-commerce chatbot with LLMs, ML models in a large scale recommendation system and way way more.

ARTICLES

Lessons Learnt From Consolidating ML Models in a Large Scale Recommendation System | 7 min | ML | Roger Menezes, Rahul Jha, Gary Yeh, and Sudarshan Lamkhede | Netflix Tech Blog

The Netflix team demonstratehow they combined multiple machine learning models used in Netflix's large-scale search and recommendation systems into a single unified model, simplifying the architecture, improving performance and enabling faster system development. They share the trade-offs and lessons learned from this approach for broader applications.

ELT is dead, and EtLT will be the end of modern data processing architecture | 11 min | Data Science | DevGenius

Let’s discuss the evolution of data processing architectures, from ETL to ELT and finally to the current EtLT architecture. This text explores the reasons behind these changes, their strengths and weaknesses and why EtLT is emerging as the dominant data processing architecture, along with open-source implementations like Apache SeaTunnel to meet modern data infrastructure demands.

How to build an e-commerce shopping assistant (chatbot) with LLMs | 15 min | LLM | Michał Madej | Part of Xebia Blog

In today's e-commerce landscape, exceptional customer service is not a choice but a must. Online shopping's growth has increased the need for personalized experiences and 24/7 support. This blog will show how to build an efficient e-commerce assistant with Large Language Models (LLMs), highlighting their development complexities and capabilities.

In MORE LINKS you will find Apache Flink and Kafka Streams: a comparative analysis, spread your wings: Falcon 180B is here, integrating Azure OpenAI with Snowflake: architecture and implementation patterns, and more.

{ MORE LINKS }

TUTORIALS

How to Write Simple and Efficient Flink SQL | 10 min | SQL | Xiaolin He | Alibaba Cloud

This article is compiled from Xiaolin He, Alibaba's Senior Technical Expert and Apache Flink PMC Member and Committer, who shared it at the 2022 Flink Forward Asia (FFA) Conference. This article is mainly divided into three parts:

1. Flink SQL Insight
2. Best Practices
3. Future Works

NEWS

The State of Serverless | 7 min | Data Engineering | Datadog

 In this report, the analysis involved examining usage data from over 20,000 customers across various major cloud platforms, where they monitored their serverless workloads with the platform. The report presents essential insights into how these customers utilize serverless technologies in practical situations.

TOOLS

DevOpsGPT | AI

Welcome to the AI Driven Software Development Automation Solution, abbreviated as DevOpsGPT. It combines LLMs (Large Language Models) with DevOps tools to convert natural language requirements into working software. This innovative feature greatly improves development efficiency, shortens development cycles and reduces communication costs, resulting in higher-quality software delivery.

In MORE LINKS: Manage Apache Kafka® Connect connectors with kcctl.

{ MORE LINKS }

DATA TUBE

Opportunities in AI - 2023 | 37 min | AI | Andrew Ng | Stanford Online

Dr. Andrew Ng leads a discussion on AI's potential and impact, emphasizing the significance of supervised and generative AI tools, the rise of low-code and no-code AI development, untapped opportunities across industries and the importance of responsible AI for addressing challenges like pandemics and climate change, while dispelling exaggerated fears of AI causing human extinction.

CONFS EVENTS AND MEETUPS

Generative AI Summit | On-site | 9th November 2023

Cut through the clutter, harness generative AI's potential for your industry. Join innovative engineers and leaders, master generative systems, build better models, find cost-effective infrastructure, and gain a strong support network for faster production.

Agenda & topics covered

• Breaking through the noise: how your organisation can innovate
• Quantifying uncertainty in generated models to create more reliable products
• Powering your GANs & VAEs with state-of-the-art compute for rapid output
• A fully monetised generative AI landscape: how to drive revenue in a new ecosystem

…and more

________________________

Have any interesting content to share in the DATA Pill newsletter?

➡ Join us on GitHub

➡ Dig previous editions of DataPill 

Adam from the GetInData | Part of Xebia