DeepSeek V4 Flash 0731

(arcprize.org)

125 points | by tosh 1 hour ago

23 comments

  • LaurensBER 1 hour ago
    I've been using it extensively since the release and the best summary I can give is that it's good enough to use it for (almost) everything and cheap enough that the cost are irrelevant. I'm running it in Oh My Pi with a second instance running as "advisor" and even with 5-6 active sessions (effectively 12 streams) I'm struggling to spend more than 5 bucks per day.

    OpenCode Go even has double limits temporarily so for 10 USD you effectively get 140 USD of tokens to spend. It would impress me if someone could burn that amount with "normal" usage. Even when running multiple sessions.

    I have a Claude Max subscription but I've barely touched it, it just feels like a step back to have to think about limits and usage even though the models are stronger.

    The beauty of intelligence at this cost (even if it's not SOTA) is that it opens a whole bunch of new use cases. Test failure in CI? Have the bot automatically propose a fix, its cheap enough that you can discard it w/h issues. Test coverage too low? Auto generate tests on CI for every pull-requests! Monitoring server logs, continuous security audits and investigating every received exception now becomes possible.

    I'm thinking about having it automatically filter and re-rank my social media feeds so I can steer the algorithm instead of the other way around.

    Perhaps other people (with enormous budgets) were already doing all of the above but for us this is a really exciting release!

    • Aeolun 1 hour ago
      But DeepSeek now has a warning they’re going to sharply increase their API pricing sometime in the future.
      • LaurensBER 1 hour ago
        Dax (from Opencode) has tweeted that they can replicate or beat the price with rented GPUs. Deepseeks secret sauce is the incredibly cheap caching (magnitude cheaper than other providers).

        vLLM has recently released a similar approach. It's not as effective as what DeepSeek does but still an interesting development.

        I have no doubt that in due time other providers will match or perhaps even beat the current DeepSeek prices.

        • minraws 42 minutes ago
          As someone who recently tried it on some blackwell cards, it's possible to match the prices especially the input can be even cheaper and output can match the costs so you can easily build a net 20-30% margin business even at current GPU prices.

          The entire issue is caching, I tried to write some custom to dump to disk kv-caching using some ideas from their papers and my experience with snapshots and vm checkpoint systems, I must say they must have really squeezed that lemon it's hard.

          Atleast me with Sol couldn't figure it out over a couple days, a few hours each day, which isn't much but I did feel a bit stuck with existing solutions and felt like I might have to write something from scratch. But if you are willing to put in the effort into the infra I do think it's doable. But it will be really hard to pull it off.

          My congrats to anyone who manages to pull it off, they might be able to kill off most AI labs. Assuming they can find the compute, Deepseek really has killed all models for me other than Sol/Fable/Opus/K3 tier stuff.

        • twotwotwo 25 minutes ago
          One read is 1) they're getting a lot of traffic for Flash, 2) they've said they're updating Pro soon and expect that to lead to a traffic spike for Pro, but 3) that would leave them overloaded, so 4) they're going to raise prices to avoid it.

          It's interesting that most open models adding 1M context did it in a way that reduces KV cache size (though DeepSeek was the most aggressive, using compressed attention on all layers), but only a couple providers turned it into a discount on cache reads.

        • onlyrealcuzzo 37 minutes ago
          > Deepseeks secret sauce is the incredibly cheap caching (magnitude cheaper than other providers).

          Can anyone working at one of the main US labs (Google, OpenAI, Anthropic) comment on WTF they haven't even tried MLA - despite the obvious massive advantages?

          I know enough to know they aren't completely incompetent. So there must be a quite good reason.

          But it remains a mystery to me.

          DeepSeek's MLA is like almost 2 years old at this time. They've got thousands of people working on this stuff. They clearly have the ability to at least try it...

          • ronsor 19 minutes ago
            Are they not?

            The big US labs are opaque and don't publish much of any technical details anymore. We don't know what they are or aren't doing, honestly.

        • NorwegianDude 58 minutes ago
          Eh, what are you guys even talking about? Deepseek is not cheapest provider as is, and it's MIT. So deepseek making it more expensive to use is just nonsense, they can only change their own pricing. It's the beauty of MIT license and open weights. If anything, these models are some of the safest in the world to use if you worry about a rug pull.
          • hagen8 3 minutes ago
            Cached input tokens are what drives most costs.
          • akman 51 minutes ago
            90%+ cache hit rate is common, and so you'll see on places like openrouter that Deepseek cache cost is indeed a magnitude cheaper than the rest.
          • LaurensBER 44 minutes ago
            There's more to inference than just the input/output token cost. Caching has a massive impact.

            Deepseek charges $0.0028 per cache read on Openrouter. The next cheapest is $0.018.

            That's a massive difference and quickly adds up on coding sessions (which often hit 95%+ cached tokens).

        • retinaros 50 minutes ago
          any link to this caching tech?
          • LaurensBER 37 minutes ago
            [Feat][Core] Add disk offloading support to SimpleCPUOffloadConnector — #49644 https://github.com/vllm-project/vllm/pull/49644

            This adds disk as a tier in the HBM → CPU → Disk KV cache hierarchy.

            There's also a cluster of related KV-offload FS PRs: #49225 (read/write batching, still open) and #49152 (batch store/load in C, merged Jul 28).

            It's hard to say if these are similar to the approach DeepSeek takes but they definitely seem very interesting.

      • ms8 57 minutes ago
        Yes, there is warning, but also there are many providers on OpenRouter[0], hosting open weight model with similar pricing. The question is Will they go up as well?

        [0] https://openrouter.ai/deepseek/deepseek-v4-flash-0731#provid...

      • eli 32 minutes ago
        I assume/hope this is about prices going up for the next release of Pro
      • HSO 40 minutes ago
        even if they double it it`s from such a low base it is still supercheap
      • metadat 1 hour ago
        Source?
    • anramon 1 hour ago
      >even if it's not SOTA

      And, probably 99.99% of people using LLM probably don't even need SOTA anyway.

      • swiftcoder 35 minutes ago
        At least on these benchmarks, it seems to be pretty handily scoring up with the SOTA from 6 months ago?
    • jmyeet 18 minutes ago
      > I'm thinking about having it automatically filter and re-rank my social media feeds so I can steer the algorithm instead of the other way around.

      I hadn't really thought about this but AI may well be the technology that disrupts and ultimately destroys social media.

      The value proposition of something like FB or IG is, as we know, the network effect. The platform gets to extract value from user generated content. I believe that users should own the platform, a bit like the Wikimedia Foundation, because they're the ones that create value. Federation is a popular belief on HN and I've come to believe that's simply the wrong solution to the right problem.

      Anyway, how these social media companies make money is by optimizing the feed for engagement. People know it too so you see people trying to build an audience by rage baiting. And then more time spent equals more advertising revenue.

      But what happens when the AI can simply slurp all the posts and then filter and rank them? It destroys the engagement and advertising model. And I'm not opposed to that, honestly. It may be on eof the few good thing sto come out of AI.

    • catigula 8 minutes ago
      >Test coverage too low? Auto generate tests on CI for every pull-requests!

      Terrible use-case.

  • SwellJoe 11 minutes ago
    DeepSeek is my cheap and cheerful Chinese model of choice for API use. Has been for a while, but now it's Flash instead of Pro. Even cheaper, and now better then Pro. I feel like most of the major Chinese models are benchmaxxed, they have weird quirks every time I use them (Qwen 3.8 Max doesn't check its work and leaves stuff broken, doesn't write tests unless prompted, etc., Kimi ends up being quite expensive and rarely better than GPT Sol or Opus 5), while DeepSeek models seem to be generally as good as the benchmarks indicate: Not the best, but stronger across the board than any model within an order of magnitude of its price.
    • eli 3 minutes ago
      Qwen 3.8 Max is very strong at troubleshooting and code review.
  • arjie 7 minutes ago
    It's not frontier, but it's far past what we had at the beginning of the year. It's very usable. I get great instruction compliance, tool calling, and with a trivial workflows flow it has very good long-running performance as well.
  • 542458 1 hour ago
    Kimi K3 was an interesting model only a month ago, and now we're looking at the same performance for 1/20th of the price. Wild how fast this is advancing.
    • whinvik 1 hour ago
      Yeah either the benchmark isn't very useful anymore or V4 Flash is a really, really good model.
      • ignoramous 56 minutes ago
        In my use, DeepSeek v4 Flash (which replaced the quite excellent MiniMax M3) lags behind GLM 5.2 & Muse Spark 1.2 (let alone Kimi K3). Also, K3 is a much bigger multi-modal model, while Flash is text-only and likely optimised for coding tasks.
        • nwienert 15 minutes ago
          Yep, and the v4 flash final is about 2.5x slower than preview making it no longer a fast model, in fact slower than Luna and bigger models in many cases.

          Spark is actually the interesting one imo. It's significantly better, also significantly faster. If you are ok with letting Meta soak up your data (which DS does too) it's also the same price.

    • thehamkercat 56 minutes ago
      And now nobody seems interested in it because the price hasn't gone down

      it's still $3/$15 for all providers on openrouter

      because of some Kimi license

      https://openrouter.ai/moonshotai/kimi-k3#providers

      • johnnyApplePRNG 8 minutes ago
        Morph has it for a slight discount, apparently.

        Uptime looks crap, though.

  • mosura 44 minutes ago
    I strongly recommend trying this for programming tasks.

    It is strong (not Fable strong though) with a much better “persona” than Opus, and very different blindspots. If you flip between Claude and this you will find both catch the mistakes of the other before they get out of control.

    On balance I actually prefer DeepSeek for programming now, because of the way it talks.

    • chorizo 20 minutes ago
      This also reflects my experience and should put to bed the distillation rumours. This model feels nothing like the Claude models, including tone and blindspots.
  • CharlesW 1 hour ago
    Last weeks's discussion (591 points): https://news.ycombinator.com/item?id=49120299
  • surprisetalk 1 hour ago
    This reminds me of those pareto-style speedrun record charts when a new glitch is discovered.

    [0] https://taylor.town/silver-landmines

    When I see dramatic leaps like this, it tells me that the important hacks haven't yet been discovered.

  • iagooar 7 minutes ago
    I love DeepSeek V4 Flash since the pre-0731, now even more. It is the first model that is truly too cheap to meter.

    But I find it having a pretty significant problem with tool calling - no idea why, but tool calling with it is SLOW. As long as the model is reasoning, all good. But give it a bunch of tools and it becomes extremely slow.

    Am I the only one experiencing this?

  • minimaxir 1 hour ago
    It's always fun when Max reasoning is cheaper than High reasoning.
    • Terretta 19 minutes ago
      Rework is expensive.

      Tell your PjM who should tell your PgM who should tell your PdM, all the PMs...

      Maybe if "the business" sees it is true of LLMs, they might believe it's true of giving better context to engineers up front then giving them time to think and prototype (thinking tokens are an answer prototype).

  • xyzsparetimexyz 28 minutes ago
    That page needs a Pareto frontier display. But wow, it absolutely demolishes.
  • gentlewater 58 minutes ago
    I’ve been refreshing hacker news constantly for a week now waiting for v4 pro, after they stated it would follow «soon». I have learnt «soon» is a matter of definition.
  • croes 9 minutes ago
  • tosh 1 hour ago
    results comparable to gpt 5.6 luna but cheaper

    promising!

    • minimaxir 1 hour ago
      Since the x-axis is log-scaled, DeepSeek is much cheaper than visually implied (mousing over the raw values, it's 1/4th the cost of Luna).
    • LUmBULtERA 59 minutes ago
      Is it still cheaper than Luna if using an OpenAI subscription? My gut is no, but I have not done the math.
      • swiftcoder 34 minutes ago
        You'd have to compare against something like the OpenCode Go subscription, and I'm fairly sure deepseek napkins out cheaper in that scenario
        • LUmBULtERA 17 minutes ago
          I'm still not sure, there's a promo going on now, but generally Go gives $60 of API credit and right now it might be $120 with deepseek. But $20/month OpenAI subscription I believe gives you many hundreds of API-equivalent usage? I've heard $100/month giving many thousands API-equivalent per month.
      • minimaxir 54 minutes ago
        Everything is cheaper if using a subscription, but some applications require API usage.
  • sourcecodeplz 27 minutes ago
    wow. i remember when GPT-5.2 (medium) was everyone's favorite.

    ARC-AGI II:

    - GPT-5.2 (medium) %26.7 ($0.759)

    - DSV4-Flash (max) %61.4 ($0.04)

  • luyu_wu 1 hour ago
    It is wild that this a log scale of cost to me!
  • esafak 1 hour ago
    It's serviceable but, like many Chinese models, it uses a lot of tokens to get work done.
    • gruez 28 minutes ago
      >it uses a lot of tokens to get work done.

      That's irrelevant when you use $/task as the metric, which the OP does use.

      • esafak 5 minutes ago
        It also affects the time.
  • clayhacks 1 hour ago
    Why wasn’t this run against ARC-AGI-3? Or did it fail to solve anything?
    • chorizo 18 minutes ago
      They tweeted that ARC-AGI-3 results take longer to run, so we’ll need wait a bit longer.
  • Havoc 1 hour ago
    They did recently announce they're increasing prices though (got a mail yesterday I think), so not sure this analysis showing it as price outlier will last
    • minimaxir 1 hour ago
      That is only when using the DeepSeek API directly. OpenRouter has 24 different providers serving it at existing prices.
  • dcchambers 1 hour ago
    This latest DeepSeek is almost at the "too cheap to meter" level. That's going to be a larger unlock than models like Fable/Mythos that are way too expensive to justify, IMO.

    What secret sauce do they have?

    • throwaway_95283 40 minutes ago
      limited resources, no modern GPUs, no $10 billion dev budgets.

      pair it with codewhale, 50 agents, 200 MB of ram.

  • WhitneyLand 20 minutes ago
    The DeepSeek team is so strong, very impressive.

    Imagine if they had GPU resources of western labs.

    • mosura 12 minutes ago
      Necessity is the mother of invention.

      SV companies get way too comfortable when they have enough in the bank to stay running more than three months.

  • antirez 1 hour ago
    Price is not a good meter. Active parameters per token are. Joule would be even better.
    • orbital-decay 41 minutes ago
      It's an excellent metric, the amount of applications not viable now due to cost/latency/throughput is vastly bigger than the amount of current use cases. Even current ones do benefit, e.g. it's a great executor subagent.

      Energy and intelligence are good too, sure.

    • minimaxir 53 minutes ago
      Price accounts for computational/architectural efficiency improvements whereas active parameters does not.
    • polytely 30 minutes ago
      for someone with a limited budget it is actually very important because it makes me less scared to experiment.
  • muricula 1 hour ago
    Price is confounded by VC subsidies, economies of scale, and inference optimizations. I think a more interesting chart would be ARC AGI vs forwards pass flops or ARC AGI vs training tokens. Of course we don't have those numbers for the closed source models or even some of the open weight ones.
    • minimaxir 1 hour ago
      DeepSeek V4 Flash 0731 is an open-weights model which means price is determined by competition/invisible hand of the marketplace: https://openrouter.ai/deepseek/deepseek-v4-flash-0731

      With the exception of cache costs, all providers have similar input/output costs.

      • kennywinker 1 hour ago
        Not counting the cost of making the model, which is subsidized by… someone? The chinese gov i think?
        • _aavaa_ 17 minutes ago
          Subsidized by inference profits and volume.
    • npn 1 hour ago
      weak argument. deepseek v4 flash is open weight, you can easily find other providers with competitive price with Deepseek (except for input caching), some even half as cheap.