Hosting-7B-Llm-On-Google-Cloud (J-sephB-lt-n/hosting-7B-llm-on-google-cloud) — Observability & Evals

Install

git clone https://github.com/J-sephB-lt-n/hosting-7B-llm-on-google-cloud.git

Repository reader

Read the project’s README, skills and supporting Markdown here. Rendered view is shown first; source is one click away when you need the exact text.

Fetched from GitHub

Loading the project’s README…

Public files are loaded on demand from the repository. The atlas does not copy or modify them.

Derived from the project's own README, install route, CI configuration and release assets — not from running it.
Platform	Runs here	On what evidence
Windows	Likely	Inferred from the language or runtime. Nothing in the project says so.
WSL2	Likely	Inferred from the language or runtime. Nothing in the project says so.
macOS	Likely	Inferred from the language or runtime. Nothing in the project says so.
Linux	Likely	Inferred from the language or runtime. Nothing in the project says so.
Docker	No	No evidence of support anywhere in the project.

Named by 1 of the 39 lists the atlas merges.

One topic, 1 harness. Each link is a prerendered page of everything else in that slice.

Closest first — projects that plug into the same harnesses, then the ones the most lists agreed on.

ChimeraforgeSahil170595/ChimeraforgeLLM deployment planner and benchmarking CLI: given a model and a GPU it answers will it fit, will it hit your SLO, and what will it cost. Searches…
GoModelENTERPILOT/GoModelAI gateway exposing a unified OpenAI-compatible API across OpenAI, Anthropic, Gemini, Groq, xAI, Ollama and other providers, with routing, usage…
GPUStackgpustack/gpustackAn open-source GPU cluster manager for running and managing LLMs
LRMnickprotop/LocalizationManagerCLI/TUI tool for managing localization files (.resx, JSON, Android, iOS) with LLM-powered translation via Ollama, validation, and code scanning for…
runtapeRehanMohammed985/runtapeFinds which part of an agent's context caused a bad decision by rerunning it with pieces removed, checks candidate fixes the same way, and writes a…
Self-Hosted AI Stackhwdsl2/self-hosted-ai-stackDocker Compose stack for local AI with Ollama, a LiteLLM gateway, RAG, voice services, MCP tools, persistent data, and health checks
TheYgental2m4n/TheYgentSelf-hosted, no-code platform for building and running AI agents on a visual canvas, with built-in local inference (llama.cpp, MLX, vLLM) or any…
Arize-PhoenixArize-ai/phoenixSelf-hostable trace UI and eval runtime for agent workflows. Lets harness engineers audit and replay every reasoning step and tool call offline…