Tag Archives: Moore’s Law

How much bigger can/should LLMs become?

Since  the “invention” of the transformers,  a neural  network technology,  similar  to Recurrent Neural  Networks  but with  the  capability to  consider a whole text in parallel, rather than processing it in a sequential way,  the number of parameters used to train the algorithm has been growing  exponentially, as  shown in …

Read More »

Celebrating Moore, and his “law”

Gordon Moore passed away  on Friday, March 24th, 2023. His observation back in 1965 in an article to celebrate the 35th anniversary of the Electronics magazine (Cramming more components onto integrated circuits) became the lighthouse for the whole electronic industry in the following 50 years. At the time of publishing …

Read More »

How much smaller can it get?

Atoms are really tiny, their dimension of the order of 0.1 nm (1 tenth of a billionth of a meter). You often hear that atoms are basically empty space, that if you have their nucleus scaled up to the size of a soccer ball and place it at the centre …

Read More »

1 person – 1 sequenced genome

The cost of sequencing the human genome has fell in these last twenty years, from a billion $ (2.7 B$ actually) to around 1,000$. It is not just the cost of sequencing, it is also the time it takes for sequencing, 13 years for that first genome, a few days …

Read More »

Stack it up!

Squeezing more transistor on a slice of silicon cost too much. Since 2014/2015 the prediction of Moore that we would be seeing a decreasing cost per transistor on chips as they become smaller no longer holds true. However packaging more transistor in a chip remains a goal, since the more …

Read More »

Copying the brain

Crunching data faster and faster is what computer industry has been doing over the last 60 years, tracking with amazing precision Moore’s law. Since 2014/2015 Moore’s Law has reached its limit, first in the economics (the price per transistor is no longer decreasing) and then in density (we can no …

Read More »

Changing the world, one nanometer at a time

I found the header for this post on the website of ASML, a company at the leading edge of lithography technology, the engine of the semiconductor industry. They have a wide range of lithographic systems including the most advanced Extreme UltraViolet Lithographic systems (EUVL) using wavelength of 13.5 nm. With …

Read More »

Going beyond impossible: 2nm chip technology

Today’s most advanced  chip technology is based on a 5nm (5 billionth of a meter) thickness of etching. For comparison the first Intel 4040 was using a 10µm technology (2,000 times “thicker”!). Going beyond that raises many issues that have led to the assumption of “close to impossible”. Going below …

Read More »

You’ve got to watch this …

I stumbled onto this amazing video infographic produced by DataGrapha that in less than 5 minutes shows the progress of electronic microprocessors against the Moore’s law. Notice that the graphics cover the span from 1971 to 2019. For the years up to 2024 it is just showing the growth in …

Read More »

6G does not exist, yet it is already here! – IV

4. Processing capacity in the devices Addressing spectrum efficiency and availability in the previous posts I mentioned over and over the need for processing power to both exploit the spectrum (efficiency) and taking advantage of available one. For the former the transmitting/receiving device needs to use multiple antennas and combine/process …

Read More »