Talk | 
Gen AI Engineering Days 2024
 | 30.10.2024

Prompt Injections, Hallucinations & More – Keeping LLMs Securely in Check

A chatbot hallucinates a very generous refund policy for a customer, and a judge decides that this AI invention is binding for the company. A user “convinces” an LLM to do anything and promptly gains access to sensitive data. Both are nightmare scenarios for a company. Nevertheless, with the great success of chatbots and LLM apps, the integration of generative AI into business applications today plays a central role in the business strategy of many companies. In this session, Sebastian Gingter will shed light on how we can develop robust LLM-based solutions that are both innovative and secure. We will discuss real examples of problems in applications that arise directly from an LLM, such as hallucinations or prompt injection attacks. You will see what measures leading providers have taken to prevent such risks and what concrete options you have to keep generative AI in check and make it a safe, trustworthy, and value-adding part of your products.

Sebastian is a consultant at Thinktecture and Microsoft MVP. He specialises in Generative AI in the business environment and ASP.NET Core.

Event

Gen AI Engineering Days 2024
29.10.24  
- 30.10.24 
@ Online
 (DE)

Links & additional Content

Slidedeck

More articles about aktuellen Schwerpunkten

AI
sg
One of the more pragmatic ways to get going on the current AI hype, and to get some value out of it, is by leveraging semantic search. This is, in itself, a relatively simple concept: You have a bunch of documents and want to find the correct one based on a given query. The semantic part now allows you to find the correct document based on the meaning of its contents, in contrast to simply finding words or parts of words in it like we usually do with lexical search. In our last projects, we gathered some experience with search bots, and with this article, I'd love to share our insights with you.
17.05.2024
Angular
sl_300x300
If you previously wanted to integrate view transitions into your Angular application, this was only possible in a very cumbersome way that needed a lot of detailed knowledge about Angular internals. Now, Angular 17 introduced a feature to integrate the View Transition API with the router. In this two-part series, we will look at how to leverage the feature for route transitions and how we could use it for single-page animations.
15.04.2024
.NET
kp_300x300
.NET 8 brings Native AOT to ASP.NET Core, but many frameworks and libraries rely on unbound reflection internally and thus cannot support this scenario yet. This is true for ORMs, too: EF Core and Dapper will only bring full support for Native AOT in later releases. In this post, we will implement a database access layer with Sessions using the Humble Object pattern to get a similar developer experience. We will use Npgsql as a plain ADO.NET provider targeting PostgreSQL.
15.11.2023
.NET
kp_300x300
Originally introduced in .NET 7, Native AOT can be used with ASP.NET Core in the upcoming .NET 8 release. In this post, we look at the benefits and drawbacks from a general perspective and perform measurements to quantify the improvements on different platforms.
02.11.2023
.NET
kp_300x300
.NET 8 introduces a new Garbage Collector feature called DATAS for Server GC mode - let's make some benchmarks and check how it fits into the big picture.
09.10.2023
.NET CORE
pg
In previous part we lerned how to pass parameters to a Source Generator. In this article we need this knowledge to pass futher parameters to implement logging.
29.08.2023

Our webinars

Our articles

More about us