Core-to-Core Latency

As the core count of modern CPUs is growing, we are reaching a time when the time to access each core from a different core is no longer a constant. Even before the advent of heterogeneous SoC designs, processors built on large rings or meshes can have different latencies to access the nearest core compared to the furthest core. This rings true especially in multi-socket server environments.

But modern CPUs, even desktop and consumer CPUs, can have variable access latency to get to another core. For example, in the first generation Threadripper CPUs, we had four chips on the package, each with 8 threads, and each with a different core-to-core latency depending on if it was on-die or off-die. This gets more complex with products like Lakefield, which has two different communication buses depending on which core is talking to which.

If you are a regular reader of AnandTech’s CPU reviews, you will recognize our Core-to-Core latency test. It’s a great way to show exactly how groups of cores are laid out on the silicon. This is a custom in-house test, and we know there are competing tests out there, but we feel ours is the most accurate to how quick an access between two cores can happen.

Looking at core-to-core latencies of the AMD Ryzen 7 8700G, as this is a monolithic Phoenix die, we can see good inter-core latencies between each of the eight individual Zen 4 cores. Going within the core, we can see solid latencies of 7ns, while things inter-core range between 17 and 21ns, showing that the Ryzen 7 8700G uses a single core cluster of eight cores. 

Similar to what we've seen on previous iterations of Zen 4 and Zen 3, albeit on processors with multiple core complex (CCXs) such as the Ryzen 9 7950 and Ryzen 9 5950X, inter-core latencies are strong and low. In contrast, the Ryzen 7 8700G and other Ryzen 8000G monolithic chips on a single die remove the complications and penalties of connecting through AMD's Infinity Fabric interconnect. The Ryzen 7 8700G uses TSMC's refined 4nm manufacturing process, exactly the same as the Ryzen 7040 mobile, which is coincidentally the exact same design as the 8700G, given that AMD has repurposed Phoenix for use on AMD's AM5 desktop platform. 

The core-to-core latency performance is inherently strong on the Ryzen 7 8700G, with low inter-core latencies. As expected, latency degrades a little going across the entire complex, but certainly not within the range where we would expect these penalties to cause latency issues when cores have to communicate with each other.

Test Bed and Setup: Moving Into 2024 and Beyond CPU Benchmark Performance: Power, Productivity And Web
Comments Locked

111 Comments

View All Comments

  • nandnandnand - Tuesday, January 30, 2024 - link

    I could have sworn that was in here, but I was probably thinking of other reviews.

    Short story long, AnandTech is dying and you should go to other sites for reviews now. And the 780M iGPU in the 8700G is not going to do well against a 2060/3060. It seems to be around a GTX 1650 in performance.
  • is4u2p - Wednesday, January 31, 2024 - link

    Uh, the M1 had dedicated NPUs in it and it is a desktop processor.

    As for these, they're Z1 and Z1 Extreme APUs rebranded, you can get these in the handheld gaming machines.
  • Stu7nm3dflash - Thursday, February 1, 2024 - link

    Certainly Apple has a lot of machine learning built in, this iPad Mini 6, has 16 tflops of ML, more than the M1, but little access to big amounts, of short term memory, my Ryzen 5 8600, only has 16 tflops, but I've given it 64GB of DDR 5 and PCIe4. Fingers crossed, for my creative work. ARM, is more power efficient, the M1,2,3, Pro, Max, Ultra, iPhone, Apple TV, iPads all have ML, plus unified memory and PCIE4. But amount of memory is also important, 64GB of DDR 5 only cost me $A200, PCIE4 $ 100, motherboard $125, chip $A375, my Mac mini M1, only has 8GB, of unified memory, it crashed immediately, under AI model load.
  • Stu7nm3dflash - Thursday, February 1, 2024 - link

    My use case, is a bit different, turning 2 stories, 11 pages into 80 pages, at first, online, I got 3 paragraphs. Then on an 8 core, 4000 series, Ryzen 7, with 32 GB of DDR 4, PCIe3, I got 4 pages, now, 64GB of DDR 5, PCIe4, Ryzen 5 8600, with 16 tflops of AI, I'm hoping for more pages, before it crashes. At double the short term memory, at double the speed, double speed long term memory, a specific AI architecture and 4nm nearly 3 times the transistor density, of 7nm, last time I used Jan.ai, plus a model, easiest build yet. Fingers crossed, more specific processing, 4 times the short term memory power, I hope I'm getting closer, memory, processing and software continue to advance.
  • GeoffreyA - Thursday, February 1, 2024 - link

    Perhaps you'd get better results with a GPU upgrade?
  • peevee - Thursday, February 1, 2024 - link

    Too bad 8700G is hamstrung by only 65W and PCIe4 (and only 2 RAM channels).

    Maybe their graphics department insisted on these things to preserve sales? APUs would be so nice at 4 DDR5 channels and 200W...
  • meacupla - Friday, February 2, 2024 - link

    Socket AM5, with its 1718 pins, doesn't have enough pins for quad channel DDR5.
    While I don't think it would require 4844 pins like sTR5 for threadripper, it would require a new socket.
  • vertigoz - Saturday, February 3, 2024 - link

    I would love to see benchmarks of ai/3d using GPU, allowing much more ram can be a major plus
  • blackie333 - Wednesday, February 7, 2024 - link

    I really care more for IDLE power consumption than maximum power because I use my PC mostly for reading/music listening. Gaming or crunching videos is not my daily routine.
    These integrated AMD CPUs have been chosen by many because of their much better IDLE power efficiency compared to normal desktop models.
    I haven't found idle power consumption comparison with older gen. models in the article.
    I'm getting old and my eyes don't serve me as good as before, maybe it's there somewhere but can't find it.
  • masb - Friday, February 9, 2024 - link

    Excellent comparison, especially regarding the OpenFOAM topic. Where can I access the complete specifications for the Intel Core i5-14600K system?

Log in

Don't have an account? Sign up now