Talk | 
BASTA! Spring 2024
 | 13.02.2024

Generative AI: Semantische Suche und LLMs Jenseits des Hello-World-RAG-Tutorials

Semantische Suche ist wohl das Paradebeispiel, um Generative AI mit eigenen Daten in eigene Businessanwendungen einzubinden. Mindestens eine Fantastilliarde Blogposts, YouTube-Tutorials und sonstige Artikel zeigen, wie man so etwas mit Large Language Models (LLMs) und Retrieval-augmented Generation (RAG) – offenbar sehr einfach – realisieren kann. Doch wie immer steckt der Teufel im Detail. In dieser Session führt Sie unser Experte Sebastian Gingter durch ein bisschen Theorie zu Vektoren und Embeddings, zeigt, was Vektordatenbanken leisten und was Splitting beim Erzeugen von Embeddings bedeutet. Worauf müssen wir beim Indizieren achten? Dabei buhlen die verschiedensten Tools wie LangChain, Azure Cognitive Search, Qdrant oder Chroma um unsere Aufmerksamkeit. Sehen Sie, wie man am Ende alle Schritte in der eigenen Applikation zu einem effizienten RAG-Prozess zusammenführt, der dann auch wirklich sinnvolle Antworten auf die Fragen der Benutzer zu den Daten und Dokumenten Ihrer Anwendung liefert.

Sebastian Gingter ist Consultant und „Erklärbär“ bei Thinktecture. Seine Spezialgebiete sind Generative AI im Businessumfeld sowie Backend-Systeme mit ASP.NET Core.

Event

BASTA! Spring 2024
12.02.24  
- 16.02.24 
@ Frankfurt
 (DE)
BASTA-19

Aufzeichnung

No Data Found

No Data Found

Weitere Artikel zu .NET, Generative AI, LangChain, Python, RAG, Semantic Kernel

Database Access with Sessions
.NET
KP-round

Data Access in .NET Native AOT with Sessions

.NET 8 brings Native AOT to ASP.NET Core, but many frameworks and libraries rely on unbound reflection internally and thus cannot support this scenario yet. This is true for ORMs, too: EF Core and Dapper will only bring full support for Native AOT in later releases. In this post, we will implement a database access layer with Sessions using the Humble Object pattern to get a similar developer experience. We will use Npgsql as a plain ADO.NET provider targeting PostgreSQL.
15.11.2023
Old computer with native code
.NET
KP-round

Native AOT with ASP.NET Core – Overview

Originally introduced in .NET 7, Native AOT can be used with ASP.NET Core in the upcoming .NET 8 release. In this post, we look at the benefits and drawbacks from a general perspective and perform measurements to quantify the improvements on different platforms.
02.11.2023
.NET
KP-round

Optimize ASP.NET Core memory with DATAS

.NET 8 introduces a new Garbage Collector feature called DATAS for Server GC mode - let's make some benchmarks and check how it fits into the big picture.
09.10.2023
.NET CORE
pg

Incremental Roslyn Source Generators: High-Level API – ForAttributeWithMetadataName – Part 8

With the version 4.3.1 of Microsoft.CodeAnalysis.* Roslyn provides a new high-level API - the method "ForAttributeWithMetadataName". Although it is just 1 method, still, it addresses one of the biggest performance issue with Source Generators.
16.05.2023
AI
favicon

Integrating AI Power into Your .NET Applications with the Semantic Kernel Toolkit – an Early View

With the rise of powerful AI models and services, questions come up on how to integrate those into our applications and make reasonable use of them. While other languages like Python already have popular and feature-rich libraries like LangChain, we are missing these in .NET and C#. But there is a new kid on the block that might change this situation. Welcome Semantic Kernel by Microsoft!
03.05.2023
.NET
sg

.NET 7 Performance: Regular Expressions – Part 2

There is this popular quote by Jamie Zawinski: Some people, when confronted with a problem, think "I know, I'll use regular expressions." Now they have two problems."

In this second article of our short performance series, we want to look at the latter one of those problems.
25.04.2023

Unsere Webinare

Unsere Artikel

Mehr über uns