Jason Haley

Ramblings from an Independent Consultant

An AZD Template for a Chainlit Azure Container App

An AZD Template for a Chainlit Azure Container App Late last year I was looking for an AZD template that uses Chainlit for a UI application and deploys to Azure Container Apps, but couldn’t find one … so now I’m working on building one. Chainlit OpenAI AssistantsAPI Azure Container Apps Starter This is a starter template that works with Azure Developer CLI (AZD) to create a Chainlit application and deploy it to Azure in a matter of minutes. The application code currently uses OpenAI and OpenAI Assistants API - I’m working on adding more functionality to it soon. The GitHub repository is here: chainlit-openai-assistantsapi-aca-starter. I’ve got the windows version of the README instructions out there, but haven’t updated the local environment steps for …

eShopSupport Series: Python Inference Project

This is the fifth part of the eShopSupport Series which covers the details of the eShopSupport GitHub repository. PythonInference Project The PythonInference Project is a python project that provides a web API to classify the case type when a new customer support ticket is entered in the system. It does this by passing the user’s comment to the API, which uses a local model from Hugging Face (cross-encoder/nli-MiniLM2-L6-H768) to classify the text. The PythonInference project is located under the src folder: In this entry I’ll cover the details of how the PythonInference project works, a few things I found interesting and some thoughts on improvements. What does it do? Steve Sanderson mentions the Python project about 39 minutes into his NDC talk “How to add genuinely …