G
Guest
Guest
Archived from groups: comp.sys.ibm.pc.hardware.chips (More info?)
On Wed, 09 Feb 2005 21:56:08 -0500, keith <krw@att.bizzzz> wrote:
>On Tue, 08 Feb 2005 22:45:53 -0500, Robert Myers wrote:
>
<snip>
>
>Seeee, that's where we differ. I'm a "latency" bigot, and I uunderstand
>that my problem is bigger than yours. Bandwidth is too easy.
>
The engineer's mistake: thinking a problem is important because it's
hard. The current memory latency to processor cycle time ratio is a
couple hundred. Did _anybody_ think we'd get away with that?
Latency is not the enemy. Unpredictability is the enemy. With
sufficiently predictable dataflow, you can fake latency, but you
_cannot_ fake bandwidth.
You have unpredictable data and need global access with low latency?
Where can I buy something that does that...cheap?
Hardware is what you understand. Hardware is the topic of the group.
The limits to what you can do with hardware to beat latency are
really...hard.
On the other hand, you have to work really, really hard even to fake
randomness. Most of the gains to be made in beating latency are in
software.
<snip>
>>
>> Oh, science is doing just fine these days. Aside from the oil
>> companies, I want to see if a company doing, say, drug discovery buys
>> one.
>
>What they're doing (or not) should be instructive. They have the bux to
>force the issue if they see some profit at the end of teh tunnel. Sine
>apparently they don't (correct me if I'm wrong)...
>
The people who are doing work where there's real money to be made
aren't necessarily advertising what they're doing. That leaves the
impression that the guys with all the color plots on the web are the
ones doing the real work. They aren't.
A clue to that reality came out on comp.arch when I took exception to
a DoE claim that Power was the leading architecture for HPC. That
exchange smoked out the existence of huge oil-company clusters of x86
that could show up on Top 500 but don't (why would they?). There is
custom hardware in use in biotech.
>> There is an interesting post on realworldtech by someone who authors
>> things like chess-playing software about the importance of having true
>> random access to memory for things like search (which is what much of AI
>> is coming down to). He also mentions the FFT. You can dismiss it as my
>> private obsession, if you like, but I prefer to think of it as a really
>> strong intuition as to what computing is really all about. Or, rather,
>> a strong intuition as to what a real measure of capability is.
>
>My *strong* intuition is opposite of yours, apparently. I really, really,
>believe we're latency bound, not bandwidth bouund. All the works seems to
>be going into trying to excuse latency.
>
Latency is incredibly important for performance of big boxes where
unpredictable contention for shared objects is the bottleneck. Since
those big boxes are designed for such (commercial) applications,
that's where the money and the effort go.
>> You are absolutely right: the guy with the checkbook writes the order.
>> If the guy with the checkbook wants to keep doing what was already done
>> twenty years ago, only just more of it, there is not much I can do about
>> it.
>
>The guy with the checkbook wins. THe guy with the biggest one can afford
>to dabble in new things like Itanic or Cell. At least the jury is still
>out on one of these. ;-)
If you stand _way_ back, some important technlogies have been frozen
for a long time: the internal combustion engine, rockets, jet engines,
turbines, electric motors and generators: the mainsprings of
industrialized civilization. Microprocessors, which are mostly just
shrunk down versions of what was pretty well developed by the sixties
are going to be the same way? Maybe. Intel made a bad bet on Itanium
changing the rules. It didn't and it's not going to, although Intel
might still use it successfully to fence off part of the market. I'm
betting on the whole paradigm of microprocessors to change from
fetching of instructions and data from memory to cache and registers
to on the fly processing of packets. I could be just as wrong about
that as Intel was about VLIW.
RM
On Wed, 09 Feb 2005 21:56:08 -0500, keith <krw@att.bizzzz> wrote:
>On Tue, 08 Feb 2005 22:45:53 -0500, Robert Myers wrote:
>
<snip>
>
>Seeee, that's where we differ. I'm a "latency" bigot, and I uunderstand
>that my problem is bigger than yours. Bandwidth is too easy.
>
The engineer's mistake: thinking a problem is important because it's
hard. The current memory latency to processor cycle time ratio is a
couple hundred. Did _anybody_ think we'd get away with that?
Latency is not the enemy. Unpredictability is the enemy. With
sufficiently predictable dataflow, you can fake latency, but you
_cannot_ fake bandwidth.
You have unpredictable data and need global access with low latency?
Where can I buy something that does that...cheap?
Hardware is what you understand. Hardware is the topic of the group.
The limits to what you can do with hardware to beat latency are
really...hard.
On the other hand, you have to work really, really hard even to fake
randomness. Most of the gains to be made in beating latency are in
software.
<snip>
>>
>> Oh, science is doing just fine these days. Aside from the oil
>> companies, I want to see if a company doing, say, drug discovery buys
>> one.
>
>What they're doing (or not) should be instructive. They have the bux to
>force the issue if they see some profit at the end of teh tunnel. Sine
>apparently they don't (correct me if I'm wrong)...
>
The people who are doing work where there's real money to be made
aren't necessarily advertising what they're doing. That leaves the
impression that the guys with all the color plots on the web are the
ones doing the real work. They aren't.
A clue to that reality came out on comp.arch when I took exception to
a DoE claim that Power was the leading architecture for HPC. That
exchange smoked out the existence of huge oil-company clusters of x86
that could show up on Top 500 but don't (why would they?). There is
custom hardware in use in biotech.
>> There is an interesting post on realworldtech by someone who authors
>> things like chess-playing software about the importance of having true
>> random access to memory for things like search (which is what much of AI
>> is coming down to). He also mentions the FFT. You can dismiss it as my
>> private obsession, if you like, but I prefer to think of it as a really
>> strong intuition as to what computing is really all about. Or, rather,
>> a strong intuition as to what a real measure of capability is.
>
>My *strong* intuition is opposite of yours, apparently. I really, really,
>believe we're latency bound, not bandwidth bouund. All the works seems to
>be going into trying to excuse latency.
>
Latency is incredibly important for performance of big boxes where
unpredictable contention for shared objects is the bottleneck. Since
those big boxes are designed for such (commercial) applications,
that's where the money and the effort go.
>> You are absolutely right: the guy with the checkbook writes the order.
>> If the guy with the checkbook wants to keep doing what was already done
>> twenty years ago, only just more of it, there is not much I can do about
>> it.
>
>The guy with the checkbook wins. THe guy with the biggest one can afford
>to dabble in new things like Itanic or Cell. At least the jury is still
>out on one of these. ;-)
If you stand _way_ back, some important technlogies have been frozen
for a long time: the internal combustion engine, rockets, jet engines,
turbines, electric motors and generators: the mainsprings of
industrialized civilization. Microprocessors, which are mostly just
shrunk down versions of what was pretty well developed by the sixties
are going to be the same way? Maybe. Intel made a bad bet on Itanium
changing the rules. It didn't and it's not going to, although Intel
might still use it successfully to fence off part of the market. I'm
betting on the whole paradigm of microprocessors to change from
fetching of instructions and data from memory to cache and registers
to on the fly processing of packets. I could be just as wrong about
that as Intel was about VLIW.
RM