In search of frontier AI at home

Analyzing a handful of local models that fit within a specific GPU memory ceiling, looking to learn how much compression impacts performance, how differently compressed models @ similar size compare, and how kv cache impacts attention in some cases. Benchmarks writeup: hkinsley.com/reflections/in-search-of-the-frontier-at-home DeepSeek V4 Flash: huggingface.co/deepseek-ai/DeepSeek-V4-Flash RTX Pro 6K discord: discord.gg/gzpPGAAwDj Neural Networks from Scratch book: nnfs.io Channel membership: youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: discord.gg/sentdex Reddit: reddit.com/r/sentdex/ Support the content: pythonprogramming.net/support-donate/ Twitter: twitter.com/sentdex Instagram: instagram.com/sentdex Facebook: facebook.com/pythonprogramming.net/ Twitch: twitch.tv/sentdex