View Single Post
  #450   Report Post  
S888Wheel
 
Posts: n/a
Default Doing an "evaluation" test, or has it already been done?

From: Howard Ferstler
Date: 6/17/2004 3:46 PM Pacific Standard Time
Message-id:

S888Wheel wrote:

From: Howard Ferstler

Date: 6/14/2004 4:41 PM Pacific Standard Time
Message-id:

John Atkinson wrote:

In message jBGyc.32786$HG.21420@attbi_s53
Tom Nousaine ) wrote:

I'm just interested in who is caring for readers (like me) and who is
not. And as far as I can see Stereophile is not in a general sense.
And that's primarily because you are carrying and occasionally

promoting
the High-End Myths and [Urban] Legends instead of emphasizing

acoustical
performance.

In your opinion, Mr. Nousaine. I am content to let readers make up their
own minds on the value of the information Stereophile offers them.

This thread is getting huge, and so I am only going to
interject a couple of comments related to these particular
statements.

It seems to me as if the editor of a magazine should be
interested in the "value of the information" that magazine
offers.


"Value of information" in this case is not agreed upon.


Well, in my humble opinion information that is erroneous is
not particularly valuable,


I would tend to agree. But I think Stereophile has a pretty good track record
on giving accurate information in their reviews. Now if you are talking about
subjective impressions this is again something that is not agreed upon as to
what is and is not eroneous.

unless you are talking about
advertisers and manufacturers who depend upon error to sell
products.


Error? I suspect they want reviewers to accurately describe the equipment in
question. Again, if we are talking about subjective impressions the idea of
what is and is not an error is not agreed upon.

And it does not matter if the reviewer putting
forth that information is just confused or doing his work to
keep impressionable readers on the edges of their collective
seats. It still misinforms the readers.


Again, if you are talking about subjective impressions you are simply assuming
you are right and others who don't agree with you are wrong. That is an axiom
that will win any agument if accepted. I don't accept it. If the reviewer is
misrepresenting factual information about the equipment then there is a
problem.


Because most audio or electrical engineers agree with
Nousaine that wire (within reason, of course) is pretty much
wire (especially if we are talking about speaker cables), it
would be proper for the editor of a magazine that supposedly
has its readers best interests at heart to make sure that
reviewers treat wire as it should be treated - and not put
forth mythologically related opinions about the performance
of upscale (and expensive) wires.


I don't think any audio review journal is required to base editorial policy on
some informal poll of electrical engineers.


No editor of any
magazine is obligated to evaluate information based on your perspective or
Tom's.


Well, of course not. However, in the case of a supposedly
accurate and technically oriented magazine they should
"evaluate information" based upon known scientific
principles and the considered opinions of scads of
electrical and audio engineers.


Steophile is not a technically oriented magazine. It is a hobbyist review
magazine that is not technical friendly. Accuracy of a subjective review
journal is an inherently paradoxal concept.


I am sure JA is already making such evaluations on a daily basis. The
success of the magazine depends on his choices in this matter to a large
degree.


It also depends upon a group of readers, who, as I have
noted in other commentaries, are sitting on the edges of
their collective seats, waiting for the latest hyperbolic
news from audio headquarters.


We know that there is a group of people buying the magazine. What else they are
doing is purely conjecture on your part. The fact that the magazine is selling
speaks to it's success.


Looks like JA is doing OK in his evaluations.


It depends upon what the magazine is supposed to do. If its
job is to entertain a bunch of naive enthusiasts
(irrespective of any accuracy issues), who have a
mythological attachment to audio hyperbole then by your
standings he is "doing OK."


Now you are just bashing unnamed readers because you don't agree with much of
the magazine's editorial content. from a purely business point of view the
magazine is "supposed" to generate sales. It appears that Stereophile is doing
so. From a philisophical point of view it is suppose to aid audiophiles in
their hobby. If audiophiles are buying it then we can conclude that at least
some of Stereophile's readers believe it is helping them persue their hobby.

However, if the magazine is
doing what it claims it is doing, namely giving useful and
accurate information to the readers (at least about wire in
this case), then maybe it is not quite so successful.


The information does seem to be mostly accurate. I rarely hear of manufacturers
claiming their products were misrepresented by Stereophile. Again, in so far as
subjective impressions are concerned accurate information is debatable. Unless
the reviewers are lying about thier impressions it is hard to say their reports
of their impressions are not accurate representations of their impressions.


If his reviewers are offering up data that is
hyperbolic in nature he is by definition (as an editor)
obligated to sort out the more extreme facts and make sure
that impressionable and naive readers are not given
(intentionally given, or otherwise) bogus or misleading
information.


Hyperbolic data? Could you cite an example of hyperbolic data? I don't

think
subjective impressions are what one would typically call data.


Well, they listen to the wires and make comments about
soundstaging, depth, clarity, etc. Seems is that is pretty
hyperbolic data.


No it is an impression. Here is an online defenition of data:
Main Entry: da·ta
Pronunciation: 'dA-t&, 'da- also 'dä-
Function: noun plural but singular or plural in construction
Usage: often attributive
Etymology: Latin, plural of datum
Date: 1646
1 : factual information (as measurements or statistics) used as a basis for
reasoning, discussion, or calculation the data is plentiful and easily
available —H. A. Gleason, Jr. comprehensive data on economic growth have
been published —N. H. Jacoby
2 : information output by a sensing device or organ that includes both useful
and irrelevant or redundant information and must be processed to be meaningful
3 : information in numerical form that can be digitally transmitted or
processed
usage Data leads a life of its own quite independent of datum, of which it was
originally the plural. It occurs in two constructions: as a plural noun (like
earnings), taking a plural verb and plural modifiers (as these, many, a few)
but not cardinal numbers, and serving as a referent for plural pronouns (as
they, them); and as an abstract mass noun (like information), taking a singular
verb and singular modifiers (as this, much, little), and being referred to by a
singular pronoun (it). Both constructions are standard. The plural construction
is more common in print, evidently because the house style of several
publishers mandates it.

At least bona fide audio and electrical
engineers would call it hyperbolic.


A bona fide engineer would not likely call subjective impressions data.

Now, all it would take
is a quick series of DBT comparisons to determine if upscale
wire is all that special. This is an issue that could be
solved pretty fast, if what we are talking about is the
audible advantages of super-duper wire.


I do not expect audio reviewers, most of whom are not making a living at
reviewing, to have to do scientifically valid DBTs for the sake of a few people
who would like that. If the demand fore this were substantial enough, I suspect
JA would consider doing mandatory DBTs or risk loosing readership.


Yep, they could DBT compare some really, really upscale
stuff to lamp cord. Given that they do hair-splitting
comparisons between different upscale wire brands and write
borderline poetry about how one brand does one thing well
and the other brand does something else well,


Hair splitting? Poetry? Nah.

it seems
likely that they could hear differences between, say, 16-AWG
lamp cord and some megabuck speaker wires with relative
ease, and do so consistently in any kind of DBT situation.

However, as best I can tell (admittedly, I rarely read the
magazine these days), all the reviewers really do is
recommend the wire based upon some very sloppy work.


Sloppy work abounds in hobbyist magazines. I have seen it in a magazine that
you write for.

Is this
what an upscale audio magazine is supposed to do? Well, it
might be just that, if what the readers want is fairy tails
and not hard and fast data.


Obviously some hobbyists want more than just data.


If an editor disagrees with some of the extreme points of
view his writers are putting forth (extreme in the sense
that some knowledgeable audio and/or electrical engineers
would strongly disagree) then he should rope them in and see
to it that they settle down a bit.


Well. that is really the editor's call isn't it? You are free to start an

audio
publication and set that rule.


Sure. However, what we are talking about right here is what
Mr. Atkinson does with his magazine. Has he ever personally
come out and said that super-duper wires can make an audible
difference, compared to more mundane versions?


I don't know. You can always ask him.

What is his
take on the subject of wire? If he agrees with all those
audio and electrical engineers that super-duper wire is
overkill, then why on earth does he let his reviewers go on
and on about special wire?


That has been answered. He allows independent opinions to be reported by his
reviewers. He does his "editing" in the selection of his reviewers. This is not
so unusual in the world of review journals. Especially those that seem to favor
independent POVs.

And why is said special wire
listed in any kind of recommended products list the magazine
publishes?


Based on the reviews and opinions of the editorial staff. The rules and methods
of inclusion in the recomended components list is included in every recomended
components list. If you are reading the list you should know the answer to your
question.


If he agrees with them, then perhaps he should not be
editing an audio magazine that supposedly is in the business
of helping consumers.


An opinion you get to have but one that clearly isn't held universally. It
seems you wish to eliminate the publication of ideas in audio with which

you
don't agree.


Nope. For example, some people prefer narrow-dispersion
speakers to wider-dispersion designs. I tend to favor the
latter, but I certainly can see the reasoning behind the
narrow-dispersion concept, particularly when we consider
that they can be installed in surround-sound systems that
generate off-axis ambiance that may be superior to what we
get with simple wall reflections from wide-dispersion
speakers.


That is not the sort of disagreement I was speaking of. I was thinking more of
the point of views that *you can't see the reasoning of*.

Indeed, one of my three systems makes use of
speakers of that kind (with surround sound, of course), and
I can see why they are so attractive to other enthusiasts,
including some very knowledgeable ones.


Well then we hardly have much of an audio idea you disagree with when all is
said and done.

I would imagine that
there are also audio and electrical engineers out there who
prefer the narrow-dispersion concept. Taste plays a part
here, I am sure.


There are audio engineers and electrical engineers that think amps and wires
don't all sound the same.


But in the case of some products (wire, for sure, but also
amps and CD players), this is not the case. Taste is not
involved when there are no audible differences at all.


A point that is not agreed upon.

At
least if we are talking about sound quality and not other
things like heft, durability, bragging rights, etc.

In other words, my problem is not that I object to certain
people's tastes. My problem is that certain reviewers are
generating information that is clearly misleading.


Clearly based on your axiom that your opinions on audio are irrefutable facts.
You loose me there.

I do not
know if they are themselves deluded or if they are
intentionally trying to dupe people in order to pump up
circulation.


An either/or proposition predicated on your axiom that your opinions are
irrefutable facts. Sorry, I'm not buying the premise so the argument goes
nowhere with me.


The BIG problem is that the people who have a psychological
dependence upon audio hype have to a great extent been
created by fringe-element journalism.


Please feel free to prove this assertion and it's prevelence in audiophilia.

That is, over the
years certain magazines have created a Frankenstein monster.


The analogy makes no sense to me.

No doubt (in my mind, at least) this was initially done,
because certain audio journalists had strong beliefs about
audibility issues. They really thought they could hear
differences, and they never really did settle down and do
rigorous comparisons to see if their impressions were
correct.

When science finally rears its head and says enough, certain
magazine editors are put into a terrible bind.


I look forward to the day that legitimate science rears it's head in
audiophilia. It looks like scientists have better things to do with their time
and resources.

If they
ignore what the engineers and scientists say they risk being
put into a tweako pigeon hole by some very intelligent
people.


What are scientists saying? Do you really think there are no scientists that
believe in amp sound or cable sound? You think there are no engineers that do
so either?

On the other hand, if they decide to become rational
themselves and adopt the scientific approach (and, for
example, say that lamp cord sounds as good as any upscale
speaker wire) they will alienate all those naive true
believers created by their overzealous writers over the
years.


I would say the your assertion that one is being irrational if they don't agree
with your beliefs in audio is highly prejudicial and is somewhat
selfrighteous(Main Entry: self-righ·teous
Pronunciation: -'rI-ch&s
Function: adjective
Date: circa 1680
: convinced of one's own righteousness especially in contrast with the actions
and beliefs of others ) .IMO It is ludicrous to think that all such people who
disagree with your beliefs are therby irrational by virtue of their
disagrrement.


Believe me, John has my deepest sympathies, because on the
one hand he would like to be taken seriously by serious
engineers and scientists, while on the other hand he would
like to keep the magazine's circulation increase or at least
hold steady.


I don't believe you.

Hard to do that if he alienates a bunch of
readers by telling them that they have been played as
suckers for years by his magazine's reviewers.

Tough call. Glad I do not have to make it.


A call that is based once again on your axiom that your beliefs on audio are
irrefutable facts and, in this case, that JA secretly agrees with those
beliefs.