Nice Tools
Utilities and libraries for productive AI/dev work.
2025
- LibreChat open source chat interface
- heygen for AI avatars
- Metrics to assess of RAG
- ragas package
- code based evaluation with haystack
- Faithfullness, context recall, etc.
- Track your carbon footprint codecarbon.io
- AI initiatives in Europe pampam.city map
- https://n8n.io/ - for simple agent set up (also with MCP)
- polymarket - betting on events happening
- dashboard of Polymarket analysis - here
- the oracle by Polymarket
- hyperbolic: get live continuation of text with LLMs tool
- tiktokenizer to count tokens tool
- Can my computer run this LLM? - tool
- marimo - drop in replacement for jupyter notebooks
- outlines - Get structured output of models without inference time constrained decoding
- OpenSearch - open source search and analytics suite that makes it easy to ingest, search, visualize, and analyze data
- MTEB scores on embedding models (HF leaderboard)
- UV as package installer (overview)
- most important commands here
- extremely good!
- Collection of RAG techniques on GitHub
- OpenRouter for easy provision of most LLMs - i.p. for overview on LLMs and API costs
- Recommended stack as of 30.01.2025 in LLM community (AIM)
- Azure AI Services (or other CSP) → Provides secure, enterprise-grade LLM APIs.
- Dify.AI → Manages LLM workflows, observability, and RAG pipelines
- Thomas Ü: helicone (caching and observability)
- Langfuse (observability)
- Databricks → Enables secure AI interaction with enterprise data.
- LangChain + FastAPI → Supports custom AI workflows and microservices.
- OpenWebUI → Acts as a chat-based frontend with role-based access.
- LiteLLM → Optimizes API routing, API management, cost control, and failover handling.
2024
- Generate PowerPoints based on files: plusai
- Parsing files for LLMs: docling
- Packing github repos in one file for LLMs: repopack-py
- Arize phoenix for LLM tracing and evaluation
- Open WebUI - open source Chatgpt copy
- Chainlit - streamlit for llm chatbots