• Ben's Bites
  • Posts
  • Daily Digest: Save 90% on your AI costs

Daily Digest: Save 90% on your AI costs

PLUS: Wild AI images flood Twitter

August 15, 2024

Want to get in front of 100k AI enthusiasts? Work with us here

Hello folks, here’s what we have today;

PICKS

  1. New blog:

  2. Anthropic now allows you to cache your prompts and it's like giving Claude a giant sticky note. It will save common parts of your prompts for some time so you don’t have to eat up the costs multiple times. How much you ask? API input costs can go down by 90% and reduce latency by up to 80%.🍿Our Summary (also below)

  3. Remember Monday? we told you that Flux models are taking over Twitter. Well, the scale of that takeover has increased. The new Grok is integrated with Flux lets you make images from those models, and they're totally uncensored. Some people love it, and others are just confused. It's wild out there!

  4. Very Berry Visualizer, ZAP’s sweetest flavor, helps you turn your automated visions into a reality with minimal effort.

    • Create connected processes and transform diagrams into automated workflows

    • Design and collaborate on workflows

    • Enhance productivity with AI visualization

    Bring your workflow visions to life with Very Berry Visualizer! (sponsor)

TOP TOOLS

  • Spok* - Your AI marketing expert designed to turn insights into data-driven strategies in 60 seconds.

  • AI Tutorials - Collection of curated tutorials to help you get the most out of AI.

  • Profundo - Automate data collection, analysis, and reporting for better decision-making.

  • Subform - A canvas for branching and remixing AI chats.

  • Volamail - Open source AI-powered email for everyone.

  • Gigabrain - Scans billions of discussions on Reddit and other online communities.

  • ToonTalk - AI friends designed especially for children.

  • Manaflow - Automate repetitive office work in tables.

View more →
*sponsored

NEWS

Unclassifieds - short, sponsored links

  • Job Boardly - Launch your next online business, fast. Create & monetize a niche job board instantly.

QUICK BITES

Anthropic now allows you to cache your prompts and it's like giving Claude a giant sticky note. It will save common parts of your prompts for some time so you don’t have to eat up the costs multiple times.

What's going on here?

Anthropic is rolling out prompt caching for their AI API, letting developers store frequently used context between calls to Claude.

What does this mean?

Here’s the deal, serious use with LLMs involves sending huge long prompts that don’t change for most of your requests. It could be in the form of:

  • Tons of examples for the LLM to reference for your task.

  • Long chats to keep the context of what you said earlier.

  • Working with long files for question answering.

And that makes a dent in your bank. But with caching, you can save the common part of your prompts for 5 mins. If you make another API call with largely the same prompt, Anthropic will use the saved part and let you run the call at a much lower cost. Not only that it makes getting the outputs faster too.

Why should I care?

It’s available now for all Claude models. Claude 3.5 Sonnet with prompt caching will get much cheaper for long chats where you need a smart AI. With Claude 3 Haiku and multi-shot prompting, you can do traditional data annotation tasks at a much affordable cost now.

AI is getting cheaper and more powerful day over day. It’s an amazing time to be alive.

Ben’s Bites Insights

We have 2 databases that are updated daily which you can access by sharing Ben’s Bites using the link below;

  • All 10k+ links we’ve covered, easily filterable (1 referral)

  • 6k+ AI company funding rounds from Jan 2022, including investors, amounts, stage etc (3 referrals)

Reply

or to participate.