From ReefsMagazine
By Rich Ross and Dr. Chris Maupin
At MACNA 25 in Denver, the potential for the new ICP-OES aquarium water testing by Triton Lab in Germany made many saltwater hobbyists swoon. The possibility of getting a real good look at what is going on chemically with the water in our glass boxes for an affordable price is incredibly appealing, since traditional ICP-OES testing is expensive and time consuming. In this installment of Skeptical Reefkeeping, we explain how ICP-OES testing works, explore the challenges of testing saltwater with ICP-OES, develop an understanding of the methods used to address those challenges, and discuss the results from the testing of a certified artificial saltwater standard that was sent to Triton Lab.
A Brief Reminder to Set the Scene
Skepticism is a method, not a position. It can be defined as a method of intellectual caution and suspended judgment. As a Skeptical Reefkeeper, you decide what is best for you, your animals, and your wallet, based upon critical thinking, not just because you heard someone else say it. The goal of this series of articles is not to provide you with reef recipes or to tell you which ideas are flat out wrong or which products really do what they say they do or which claims or which expert to believe. The goal is to help you make those kinds of determinations for yourself, while developing your saltwater expertise in the face of sometimes overwhelming or conflicting advice.
Introduction: Why We Don’t all use ICP Testing Already
When reefkeepers daydream about water testing, they tend to imagine testing their aquarium water with a university or research institution’s complicated and expensive inductively coupled plasma (ICP) mass spectrometer or optical emission spectrometer, because, when properly calibrated and used, these instruments can produce incredibly accurate and precise results. However, a request to test tank water often is met with the response “Get that the hell out of my lab” from the lab technician, or by a seemingly outrageous price from a commercial lab. Saltwater presents ICP testing with special problems. Most notably, it can be detrimental to the instrument’s components, and the saltwater itself can help produce unreliable results. Compensating for these issues makes the testing expensive and time consuming. Sometimes months are required to get results, and at considerable financial cost: sometimes hundreds if not thousands of dollars per analysis of each individual element. However, Triton Lab is now offering ICP OES testing of 321 elements in a saltwater sample for a reasonable cost and a fast turnaround2 – a service that no other ICP-OES lab seems willing to provide. In the Skeptical Reefkeeping series, we often quote They Might Be Giants – “Are you sure that that thing is true, or did someone just tell it to you”3, and in that spirit we looked at some of the Triton Lab claims and are sharing our results. It is important to note that that being skeptical is not the same as being cynical, and that nothing would please us more than an inexpensive, accurate and precise water test providing values for 32 elements in a single report at a relatively inexpensive cost; however, understanding traditional ICP-OES and the numbers from our experiment tell a more complicated story.
How ICP-OES Works
In chemistry class, many of us became familiar with a flame test, where you put some stuff in a Bunsen burner and watch what color the flame burns, indicating what elements are in the stuff you burned. Table salt, for example, turns the flame yellow/orange (fun fact – both authors suffer from poor color perception) due to the presence of sodium in the salt. This test is the beginning of many a mad scientist – Muhahaha! Colored flame! An ICP-OES, when distilled to its most bare fundamentals, is a sensitive, quantitative means of performing a flame test. Instead of a natural gas flame in a Bunsen burner, it uses an argon plasma torch to burn the ions and record the colors they produce, and how brightly, which tells us what elements in what amounts, are in the sample. Muhahaha plasma! The ICP in ICP-OES is the inductively coupled plasma, while the OES stands for optical emission spectrometer.
The Gory Details
Conventional ICP instruments use argon gas, swirling it in a helical fashion in concentric quartz tubes. A high power (typically approximately 1500 watt) radio frequency (RF) power generator is attached to a copper load coil that surrounds this quartz “torch.” This RF power causes an alternating current to oscillate within the load coil, producing RF magnetic fields within the inert argon gas. An initial spark capable of ionizing some of the argon is applied. Ionization means that free electrons are generated in the torch. These ions are then slingshot by the load coil fields, smashing and stripping other electrons and argon atoms (the “inductive coupling” part of ICP), creating and maintaining a plasma discharge. The process raises the temperature through collisions of argon atoms and ions and electrons. Typical analytical ICP temperatures are 7000K – 10,000K, and are appropriately a whitish blue color (fun fact – the surface of the sun is only approximately 5770K). Atoms to be measured in a solution (seawater is considered a solution) are first nebulized into a fine mist using dry argon gas. These mist particles are then carried from the spray chamber into a ceramic injector that reaches into the plasma and strips away any remaining water molecules, leaving individual particles (this process is known as desolvation). These particles are injected into the hotter areas of plasma, where they become fully atomized. Subsequently, the electrons in the atoms undergo thermal excitation from ground state (the state of least possible energy) to the point where outer electrons are lost and the atoms become ionized. Remaining electrons return to the ground state from excitation and emit electromagnetic radiation in the form of photons of discrete wavelengths. Every electron returning to the ground state emits photons with characteristic wavelengths, with many being in the ultraviolet (UV) and visible spectra. This energy difference (between the exited and ground state) is related to the wavelength of photons emitted. Each element has a characteristic emission spectrum, which means that the photons are only emitted at certain wavelengths and these wavelengths can be used to identify the presence of an element and the intensity of the emission can be used to determine the concentration. The photons are separated into distinct photon “beams” of different wavelengths. Once these wavelengths have been separated, the number of photons are then assessed and recorded for each wavelength via one of many potential collector types (photomultipliers, charge transfer devices, etc.). Calibrations, discussed later, relate these photon counts to actual analyte (what we’re measuring for) concentrations.
Five Challenges of Testing Saltwater with ICP-OES
1) Interference One of the fundamental drawbacks from highly effective thermal excitation in a rich mix like saltwater is the likelihood of emission wavelengths from the different elements in the sample overlapping and causing interference in measurement. This interference can make the results of the testing for any particular element inaccurate. Ideally, many elements of interest are isolated from this brutal cocktail of dissolved solids by methods that are dependent on the element itself. The details of such techniques have formed the foundations of entire dissertations and scientific careers. Since they are testing 32 elements at the same time, we are unsure how Triton Lab is dealing with this interference challenge. In online discussions and personal communication, we have been told that they are utilizing proprietary techniques. However, without knowing what techniques Triton Lab is using, we are unable to judge its effectiveness as compared to existing published methods and standards: no other lab has been able to affordably overcome this interference problem.
2) The Nebulizer To nebulize and separate (desolvate) the atoms in the sample from the solvent (the solvent in this case is water), the solution must be pumped through a fine orifice, where it is turned into a cloud by the dry argon gas inside a spray chamber and carried into the ICP torch injector. The injector is typically a ceramic tube that passes the atoms into the plasma, where they are desolvated, ionized and excited. As a result of this function, the injector is prone to becoming clogged by solid build up of material in the sample. The more dissolved solids in the sample, the faster the build up. Since saltwater is chock full of dissolved solids, injecting saltwater often clogs the injector. In other words, the ICP gets salt creep, which plays havoc with the sensitivity of device, causing changes and drift in the analysis. Samples like saltwater with a high amount of dissolved solids require special techniques that take time and cost money to dampen solid build up in the torch injector. To make things more complicated, different nebulizer designs can be implemented to help reduce or slow this build up. The most prevalent design, the concentric nebulizer, however, is especially prone to this issue.
We have asked Triton Lab which nebulizer is being used and how the solid build up is being managed they have not answered this question directly – presumably for proprietary reasons – and we are therefore unable to comment on what influence, if any, it may have on the Triton Lab results.
3) LOD – Limit of Detection The limit of detection (LOD) is expressed as the concentration derived from the smallest quantity of an analyte that can be detected with a reasonable certainty for a given analytical procedure. A common misconception of the LOD is that it defines the smallest concentration that can be measured. However this is not the case, it defines the smallest concentration at which we can decide if the element is present or not. In other words, being able to distinguish a signal from the background noise. To determine LOD a “blank” solution is used. For aquarium saltwater, an ideal blank would be an otherwise complete seawater matrix with the element of interest (e.g., iron), completely absent. Several samples of the blank solution are analyzed. The mean and standard deviation of the blank background noise is recorded at the wavelength of the element of interest. The smallest measure of the element of interest that can be detected with reasonable certainty, is three times the standard deviation of the blank background noise This “smallest measure” is converted to concentration via the Sensitivity S, which is defined as the change in concentration divided into the change in counts per second of light striking the instrument detectors (slope of the calibration curve). Since the concentration in the blank is zero, the concentration of the element is three times the standard deviation of the blank times the slope of the calibration curve. This concentration is reported as LOD. Triton Lab reports LOD as a range. When asked about this in online discussions and personal communication, we were told that this is because of difference in calibration and that different calibrations will result in different LOD’s. The concern we have about this is that the aquarist doesn’t know which calibration is being used at the time at which their test was done. If the test result falls between the LOD range given, it may be below the actual LOD which means we cannot determine if the element is present or not. See below for a discussion of concerns regarding how elements below Triton Lab LOD are expressed.
4) Calibration Calibration is how the counts of light per second are translated to concentration values of the element of interest. At some level, there are nonlinearities in calibrations, despite extremely high correlation coefficients in calibration curves reported by Triton. Calibration curves should be generated using solution concentrations to bracket expected values of the element of interest as closely as possible. The ideal way to do this would be 4 calibrations for each element to be tested. The first calibration should be the “matrix blank”, the matrix being the solution you are testing (in this case seawater), which would have everything that would normally be in the matrix except the element for which you are calibrating. The second, third and fourth calibrations should be the matrix (again seawater in this case) with the element of interest at low, medium, and high concentrations that bracket the expected concentration value of the solution to be analyzed. This allows nonlinearities that arise from matrix and overlap issues to be accounted for properly and will ultimately lead to more accurate results. Calibrating for all the elements in seawater at the same time usually leads to incomplete accounting for potential matrix interference (see Interference above). According to “TRITON ICP – accuracies and limits of detection V 1.1”4 – “We carry out a full calibration on our ICP-OES every day before testing and after every 30-40 tests.” For the small amount of money being charged for testing it seems improbable that each element is being calibrated individually. Since we don’t know the methods of calibration Triton Lab is using, as we are told they are proprietary, we don’t know that Triton Lab calibration appropriately accounts for the drift and interference present in all ICP instruments.
5) Alpha and Beta Error During actual testing, if enough photons reach the detector to surpass the LOD, there is a 1.0% chance of this detection being a false positive. This is referred to as the alpha error (see Figure 1). However, because the distribution of the light counts measured in the blank and the element tested overlap at the lower end of the LOD distribution there is statistically a 50% chance for false negative. This is referred to as the beta error (See Figure 1). In true analytical chemistry, the LOD is typically referred to only in cases where a binary, qualitative answer is required: Is the element of interest present, or is it not? If yes, then you can be confident (99% confident) that it is not a false positive. However, if the element appears to be absent, keep in mind that your odds of it being a false negative are the same as a coin toss! There is a 50/50 chance that the element is still present, and you cannot know by the very definition of the LOD!
To actually quantify photon counts into meaningful concentration values, relating them to how much of the element is present in the solution, there must be enough of the element present to reach or surpass the limit of quantitation, or LOQ. The LOQ is the minimum amount of the element that must be present to be quantified within specified accuracy and precision limits. Often, the LOQ requires anywhere from 2 to 10 times more of the element to be present than the LOD value, but it is dependent on each matrix, element, and OES instrument, and it must be critically assessed by a skilled analyst. So why does this create a noteworthy issue with respect to ICP-OES and seawater? To achieve measurable concentrations, many elements require preconcentration, or artificially increasing their concentrations in solution sometimes by an order of magnitude or greater. Many preconcentration and coprecipitation (the removal of a particular element from the matrix for independent quantification) techniques have been developed in earnest for specific elements, and viably remedy this issue, or work around it. Ultimately, however, many trace elements simply require more sensitive or specific techniques, which are beyond the scope of our discussion here, to accurately measure the concentration of certain elements in seawater.
From online discussions and Triton Lab documentation, it appears that Triton Lab does not preconcentrate or coprecipitate samples to be tested, and that results for all elements are determined at the same time by a single processing of the sample. It is also unclear how LOQ is being determined or if the alpha error is being considered. It is important to note that because of beta error, when Triton Lab reports a value of 0.00 for a particular element, depending on the photon counts at the wavelength of interest actually being registered by the detector, there may be a 50/50 chance that that element is actually present.
Testing the Test
Triton describes their services by saying “The TRITON water analysis is the first and most accurate trace analytic laboratory service for marine hobbyist and professional aquarists,”5The Triton US Facebook page elaborates by saying “Triton is a highly accurate, professional product with a sophisticated scientific pedigree.”6 However, the issues we have outlined above make it difficult to judge and assess the validity of these claims as Triton Lab methodology seems to be different from any other methodology being used today. We don’t know what proprietary techniques are being used or how well they work, we don’t know what kind of nebulizer is being used or how it influences results, there are LOD and Alpha error as well as calibration concerns. In the absence of the knowledge to make informed assessment of the ability of the Triton ICP-OES to deliver as claimed, the only other alternative left to us is to run some blind tests through Triton Lab using known standards and methods, and to compare the results against the known standards.
An artificial seawater standard was obtained from High Purity Standards Certified Reference Material – Seawater (CRM-SW)7 and sent to Triton Lab for testing. This standard is prepared volumetrically and gravimetrically, and is intended and designed to be used to compare analytical values generated by testing devices like ICP-OES. The amounts of the different elements in the standard are accurate, precise and certified, so running the standard through the Triton Lab process allows us to assess the accuracy and precision of the Triton Lab testing.
It is important to note that the certified artificial seawater standard has been acidified such that it contains a final composition of 2% HNO3 (nitric acid) by weight. This acidification is standard operating procedure for preparation and storage of natural waters and standards, as it is considered a requirement to prevent loss of analyte from solution (in this case, the 32 elements to be tested) primarily through adsorption to solution container walls. The 2% nitric acid in the certified artificial seawater standard has no meaningful impact on ICP-OES test results (see Figure 2). The standard was separated into three identical samples, and each submitted to Triton Lab as separate samples to be tested individually. We did not inform Triton Lab about the samples beforehand, which ensured that the samples of the standard would not get any special treatment or be treated differently from the other eight samples of aquarium water that were sent at the same time.
In personal communication with Triton Lab and Triton US, we have been informed that Triton Lab does not acidify their standards used for calibration because they claim “samples not sent in seawater will not test accurately”, nor are samples to be tested acidified prior to shipping (fun fact – Like many things in this hobby that have cautionary Safety Data Sheets like salt mix, calcium hydroxide, vinegar, test kit reagents, salt water, etc, samples acidified in this manner do not constitute “hazardous” hazardous materials); since Triton Lab seems to be the only lab testing in this manner, we cannot comment on this non-acidification because we are not aware of any method that forgoes acidification while still claiming to maintain the integrity of analyte concentrations in solution.
Analysis
For this discussion, we need to differentiate between precision and accuracy8. Accuracy is how close the result is to the actual value of the sample, and precision is how close multiple tests are to each other. Usually, when testing aquarium water, accuracy is almost always an unknown, and you are relying on the test itself to give you a value. In this case, with the CRM-SW sea water standard, we know the actual values of the each element in the standard, so we can determine the accuracy of the test. Since we had three samples of the standard tested, we can also estimate how precise the testing method is.
Accuracy
As an example, the iron value (see Table 1) in the CRM-SW standard is 21 µg/l, and the average of the three measurements performed by Triton Lab of this reference standard is 41.23 µg/l. Assuming a Normal Distribution of data, the two-standard deviation distribution of the three analyses was ±1.6 µg/l. In other words, if we were to measure our reference material a fourth (or fifth, sixth, etc.) time with the Triton testing, there is a 95% chance that the value will fall between 39.63 and 42.83 µg/l. Note that the standard value of 21 µg/l is outside this range. This also means there is a greater than 95% chance that any measurement will not overlap with the known value of the standard. Thus, the reported results will not be accurate by the definition of accuracy: that the measured value and the known value are indistinguishable within the limits of uncertainty of the method. In our case, this uncertainty is estimated by two times the calculated standard deviation of the three replicates of the instrument.
Strontium is a good example of an element that produced one of the most accurate results in our experiment (1.14% relative accuracy), where the reference material value falls within the distribution of the Triton data, but we should take a moment and look at one of the most inaccurate results. The manganese value (see Table 1) in the standard is 10.3 µg/l, and the average of the three measurements performed by Triton Lab of this reference standard is 50.88 µg/l, with a 95% chance that any measurement of manganese will fall between 50.66 and 51.10 µg/l, again based on the distribution of the three replicates. In relative terms, the Triton test returned a result for manganese inaccurate by (difference between known and measured values, divided by the known value) 396.42%.
Precision
The precision in this context is the quantification of the distribution of values upon repeated analyses of the same sample, and is independent of accuracy. In regards to our experiment with the saltwater standard, the standard deviation divided by the mean gives us a distribution of the measured values relative to the mean amount of each element reported by the instrument (also called relative standard distribution). In the case of this Triton Lab result for strontium this relative standard deviation is 1.61%. This is a fairly common ballpark specification for precision (1%), so here the instrument performs, as it would be expected to perform. The other elements tested by Triton Lab fall mostly within the same precision, so the relative precision of Triton Lab testing for strontium is good.
The detailed results for the different elements are shown in Table 1. As seen from the results, the relative accuracy and relative standard deviation range vary considerably for different elements. For instance, consider copper in contrast to the above example of strontium, where both accuracy and precision are excellent. Copper tends to be a concern for marine aquarists in general, so it would be a boon to have both accuracy and precision for this element. The relative standard deviation for copper in the three replicate measurements is 19%. The exact same solution gives measured values with a range of 5 µg/l. The average of the three measured values is 13.6 µg/l, whereas the certified concentration of the standard is 10 µg/l. This is an example of an element that actually is accurate within the precision of the Triton Lab instrument – but only because the precision of the instrument is large enough that a Normal Distribution of measured values for copper encompasses the true, certified value, based on our 3 measured replicates. If we only had a single measurement instead of three, we couldn’t be sure how large the distribution was, nor would we be able to comment on the precision of the instrument.
“Fitness for Purpose” – A Hobby Gray Area
In online conversations of using Triton testing ICP-OES for reef aquariums, the idea of “fitness for purpose” was expressed as selling point. The issues outlined above regarding using ICP-OES for testing many elements in a single, non-concentrated test and limits based on LOD were discussed. After discussions of proprietary methods for dealing with those problems (which we problematically don’t know about) were tabled, the idea that even if Triton Lab testing wasn’t going to be as accurate and precise as the normal ICP testing, it was still good enough for reefkeeping, and that the Triton Lab testing was “fit for our purpose”. The reality, as it so often is, is more complicated.
According to the Triton US Facebook page, “Triton is a highly accurate, professional product with a sophisticated scientific pedigree. It’s not part of a grandiose thesis-level research product. Although it utilizes some of the most sophisticated technology available, it’s not intended to be utilized in academic research. Rather, it’s designed for professionals and hobbyists who would like a higher level of understanding about the composition of their reef aquarium’s water, with very sensitive limits of detection.”9This kind of language makes our skeptical alarm bells start to ring. If Triton is highly accurate and professional with a sophisticated scientific pedigree, we have a hard time understanding why its results are only fit for purpose for reefkeeping – especially if those reefkeeping purposes are described as needing very sensitive limits of detection. Later in the same piece, Triton US says that “Triton’s testing has been utilized in practice at public and private aquariums all over the world for the past 7 years- a testimony to the accuracy and usefulness of this product”which also makes our skeptical alarm bells ring. Not only is the research done at public aquariums often academic research published in peer reviewed journals, but the last part of the statement is fallacious10 as the use of a product does not testify to its accuracy. People using a product simply means that people are using it, not that it actually does anything; lots of people may use ginger or bananas to cure ich, but that doesn’t mean that ginger or bananas actually cure ich11 (fun fact – ginger and bananas do not cure ich).
Marketing points like the above aside, are the results of the Triton test fit for our purposes? The answer to that seems to be “maybe” and “it depends.” The strontium value in the SRM-SW standard is 12.3 mg/l, and the average of the three measurements performed by Triton Lab of this reference standard is 12.44 mg/l, and your initial thought could, and should, be “that’s really pretty close!” Whoo hoo, right? Hold on a sec. The manganese value in the standard is 10 µg/l, and the average of the three measurements performed by Triton Lab of this reference standard is 50.88 µg/l. Your initial thought regarding Manganese could, and should be, “That’s not close at all!” Boo hoo, right? Whoo hoo or boo hoo seems to be element specific in regards to the Triton Lab results we received.
So Where Does that Leave Us?
It is our opinion that some element results of the Triton Lab ICP-OES testing may be fit for our purposes, or may be close enough as to be considered fit for our purposes, while others may not. We suggest that readers go through Table 1 and take a look at the relative accuracy of each tested element and make their own decisions. The conclusion of the thought experiment on the strontium data is that the Triton instrument is pretty good at capturing the same elemental values on a sample measured multiple times. This is a good thing. However, the accuracy of the elemental measurements is lacking. We think that Triton testing might be useful for looking for trends or for pointing out large excesses or lack of a particular element known to be problematic, but that using the results to fine tune trace element levels may not be feasible. It should also be noted that our three tests were done at the same time, which means we really only know the precision and accuracy for that one day, and that on other days when the specifics of the ICP-OES instrument are different, the relative precision and accuracy may be different. More replicates over time would build a clearer picture of the distribution of Triton Lab results. It is also important to point out that Triton seems to list results that are below the instrument’s LOD as 0.00, which may be misleading. There are levels between 0.00 and Triton’s lower limit of detection (these vary depending on the elements), but the instrument cannot read those low levels. Additionally, we worry that listing results below the LOD as 0.00 might mislead aquarists to think their levels are actually 0.00 when in reality it is unknown what the levels are. Changing 0.00 to something like ND (not detected) on the results might help avoid this confusion. There are also alpha and beta error issues to consider. Standard deviation calculations can be easily performed in spreadsheet software, and you can perform these exercises for any of the reported CRM-SW results presented here.
Fun fact – both authors would like nothing more than Triton Lab proprietary ICP-OES methods to be published, repeated, and accepted because such methods, once verified, could turn what we currently know about ICP-OES testing on its head. Inexpensive, easy, accurate and precise testing would be a huge benefit to the hobby and the scientific community at large. We encourage you all to think critically and skeptically regarding Triton Lab testing results and marketing claims, and this article. Thanks to Craig Bingman, Sanjay Joshi, Jennifer Flannery, all the participants in online discussions, Triton Lab and Triton US for their help in preparing this article, and a Special thanks to Jim Welsh for his amazing and incredibly helpful proofreading abilities.
Notes
After this article was published there was much discussion regarding our testing. Triton was not please with the article and posted a list of questions that they said they would go through systematically to help clear up confusion. To the best of our knowledge, they never addressed any of the questions. Below are the questions, as well as our response to some of the issues raised: List of questions posed by Triton (click here to go to one of the forums in which the discussion took place): “First i would like to ask you Randy and Craig, do you have access to a ICP-OES of the newst generation approx 4 years old ( like ours ) without any restriction to use it ? Don´t get me wrong , I am asking because of the possiblility to experimentaly try some stuff that possibly will come up in the discussion , as we work very practical in that point. Otherwise in some points we will only be able to go by scientific papers , wich in a practical way will not help to much. In my opinion the Article is mixing up a lot of things that we should saperate from each other, to not let the discussion get caotic ( like the article ). I can filter following questions out of all that have been said in the article and here : 1. Is TRITON ICP-OES testing PRODUCT good and helpfull for practical reefkeeping ( hobby or public aquaria ), is there a Value to the testing for this purpose. ( Fit for Purpose discussion ) by all informations we have right now ( Article and reality ) ? 2. Is TRITON ICP-OES testing PRODUCT good and helpfull for any other purpose like academic or scientific publications or a legal survey on court … ? 3. How has TRITON managed to overcome the problems coming with ICP-OES testing of seawater and why is that possible as cheap or at all ? 4. Do the guys from TRITON know what they do ? 5. What does the DATA in the Article realy tell us and wich value does it have for the Reefkeeper, also how much weight does it have acording to the Fit for purpose discussion ? 6. Is there anything that can make the customers of TRITON feel more confident with the testing ? is there any need to feel more confident with TRITON ? what would be the best way to get this confidence ( from the viwe of the reefkeeper )? 7. How accurate / precise is TRITON TESTING PRODUCT and how accurate /precise, for wich purpose it need to be ? 8. Chemical geek questions like is Iodine testing effected by acid ? wich elements will be effected by acid ? in detail wich sideeffects will bacteria, (nano)particles, Matrix diviations/variations… have on the testing. 9. Is there any way that the TRITON TEST PRODUCT user wll be able to determine the accuracy / precision in his own personal TEST matrix ? I think by going trough a planed discussion like that all of us would be able to contribute better, and the information for the audience will be more informativ. Please feel free to add anything i could have missed. I will chime in and start with the first question then. sorry for the bad english. All the best Ehsan” Our response to issues raised about the article (click here to go one of the forums where the discussion took place): “Thanks everyone for the discussion so far. Both here and other venues we have been assured that the idea of legal action is currently a non-worry. For this we are thankful. We are concerned about some of the motivations that Ehsan has been attributing to the article and its authors, as they are not accurate. We have do not have anything against Triton, we do not have something against Ehsan’s family, we are not planning on setting up a competing business, and we no reason to try to skew the results in any particular way (all of these accusations have been said by Ehsan in various places). Both of the authors have careers that they aren’t planning on giving up, and neither of the authors have any interest or anything to gain by doing something that could tarnish their own reputations. There is no intent to ‘gotcha’ anyone, to fool anyone, to use percentages in confusing or misleading manner, to manipulate data, and we don’t feel the article is disparaging to Triton. Perhaps there is the issue with Ehsan’s English combined with his trying to protect his company that helped him post things he may not have meant – we are going to hope that this is the case. The point of the article was to discuss the issues of ICP-OES and saltwater, explore some of the questions about how Triton is addressing those issues, and to present data from the certified reference material we sent to Triton to give a snapshot of the precision and accuracy of the testing. As we said in the article: fast, inexpensive, accurate and precise testing of saltwater would be fantastic for many reasons. We were pleasantly surprised at how well Triton Lab actually tested out in regards to the certified reference material. We are also quite surprised at some of the negative reactions to the article. For instance, reference after reference, as well as expert after expert, indicates that 2% nitric acid will have negligible effects on the testing results in both radial and axial ICP-OES. The acidification of samples is simply not an issue for any other ICP-OES analyst besides Triton. Triton has not provided any evidence as to why it is a problem for their testing, they just say it is a problem. This is unconvincing. The results we published seem in reality not bad for Triton, so I am unsure why the push is there to discredit them. Discussion about potential problems with the reference material itself are confusing as HPS makes these reference materials to be used exactly the way it was used in the article. Why should we trust that company supplying the reference material more than Triton Lab (at least at this point)? Because many labs around the world use HPS for a great many things, HPS always under intense scrutiny, and HPS offer’s a certified reference material. Triton is currently a private lab with no external oversight or corroboration. Again, the results published in the article seem not bad for Trition, so I am unsure why the push is there to discredit those results or the HPS reference material. It has also been said that the certified reference material in 2% nitric acid is not seawater, and that Triton Lab only tests seawater. This makes little sense to us, as it seems no hobbyist is sending Triton Lab actual seawater, but artificial salt water that may contain any manner of unknown constituents that could impact testing in any number of unknown ways. In the sense that all hobbyist samples are ‘sea water’, so is the reference material we sent to Triton, the only difference is that the reference material has been stabilized with 2% nitric acid (which has been shown to have negligible effects on this type of testing). Again, the test results seem not bad for Triton, so the push to discredit the results seems strange. Furthermore, Triton representatives themselves contacted HPS to inquire as to any issues with running a 2% nitric acid matrix despite non-acidic calibration standards; the HPS personnel corroborated the statements we made in our article. Some of the discussion about the realities and practicalities of the acidification of samples also seem without support; such acidification is not difficult, nor dangerous. It has been said in several places that a 2% nitric acid solution of 100l has 2l of acid in it – as if this is a thing to be scared of. However, the two percent nitric acid refers to the weight percent, not volume percent. The density of 2% nitric acid at 25°C is 1.00778 kg/L. Two percent of this, by weight, is 0.0201556 kg, and is the mass of pure nitric acid in one liter of solution. Multiply this mass of pure nitric acid by 100, and you get 2.01556 kg total, the mass of pure nitric acid in 100 liters of 2% nitric acid. Pure nitric acid has density of 1.504 kg per liter. Thus, dividing 2.01556 by 1.504 informs you that a 100 L aquarium of 2% nitric acid in fact contains 1.34 L of actual nitric acid. These types of calculations, and comprehension of the difference between weight percent and volume percent, are a critical component of the most basic understanding of analytical chemistry and are crucial when reporting testing results – which makes us nervous about other shortcuts that may be used in Triton Lab calculations or methodology. It doesn’t seem Ehsan has formal chemistry training, so perhaps the need for such attention has not been sufficiently instilled in him, but they are very important – there is a big difference between 1.34 and 2. Almost more important, saying there is “2 liters” of acid sounds really scary – but that “2 liters” is mixed with 98 liters of other stuff, and it isn’t going to jump out of solution and give you acid burns. As Craig Bingman pointed out, the personal protection equipment that is standard for handling a solution of 2% nitric acid is exactly the same as for saltwater or seawater. We are also worried about the discussion of personal protective equipment in the Triton Lab. Ehsan writes “… and for sure lab coat, protective eyewear and gloves and all kinds of needed signs and declaretions…. ( safity is very important, and german government is very strict in that point ). Just to let you know all Pics on the webpage are original pictures of our facilities, not “faked buyed ones” . and even the hands on them are my hands” However the photos linked to support how much safety is important show lab work being performed without a lab coat or gloves (eyes are not shown in the pictures), which leaves us with a feeling of confusion – does Triton lab use PPE or not? They didn’t use any PPE while doing testing at MACNA. PPE are important for any lab work for both the safety of the lab technician as well as to ensure the integrity of the samples. Since the article appeared in the Skeptical Reefkeeping series, we feel that it is important to bring up the idea of Trust and the ‘proof is in the pudding’ ideas that have come up in discussions of the article. Trust is a difficult one for everyone. Anyone selling you anything says ‘trust me’, and given how many times people have been misled by such trust we need to be careful. There is a list of products for reefkeeping as long as my leg that have told us to trust them, however, upon closer scrutiny, it turns out that that trust was unwarranted. It isn’t that we are saying that Ehsan is not trustable, rather that other evidence to support his claims would make him more trustable. The idea that the proof is in the pudding – how wonderful the Triton aquarium looks – has nothing to do with the article about Triton Lab testing. There are a million ways to run a reef tank and a lot of them work and create amazing results. The article looks at the testing methods, precision and accuracy of the test results and specifically says nothing about how those values should be used or the Triton aquarium methodology because we simply do not know if something like elevated lithium is problematic in tank water or in a commercial salt mix. Another idea that has come up several times in several places is that people should go to Triton Lab in Germany so they can see for themselves what is being done. This seems confusing and unnecessary for customers to spend time and money to travel to become comfortable with testing methodology when that information could easily be supplied in writing. We think a real discussion might be helpful and needs to start with Ehsan answering some of the questions he posed in his list in a straightforward manner, with some support besides ‘trust me’. Or, he could say ‘the data in the article shows pretty much what we have been saying all along, and gives people a independent way to understand the test results they get from Triton’. Finally, we hope that Ehsan takes all of this in the neutral spirit intended – to continue discussion and share and develop knowledge and understanding. Rich and Chris” Here is another forum in which such discussion took place.
- Phosphate is a calculated result, not a tested for result, so only 32 elements are tested for by Triton Lab
- http://www.triton-lab.de/index.php?id=25&L=1 $49.00 – http://triton-us.com/
- “Put it to the test” from the album “They Might be Giants – Here comes Science”
- TRITON ICP – accuracies and limits of detection V 1.1
- http://www.triton-lab.de/en/triton-lab/
- http://www.reef2reef.com/forums/triton-us/175064 andhttps://www.facebook.com/tritonLA/photos/
- http://www.highpuritystandards.com/
- See Skeptical Reefkeeping 9 for a longer discussion of precision and accuracy
- http://www.reef2reef.com/forums/triton-us/175064 andhttps://www.facebook.com/tritonLA/photos/
- See Skeptical Reefkeeping 1 for a discussion of fallicies
- See Skeptical Reefkeeping 1 for a discussion of ich treatments
- http://images.alfresco.advanstar.com/alfresco_images/pharma/
- http://www.pjoes.com/pdf/19.1/59-64.pdf
After this article was published there was much discussion regarding our testing. Triton was not please with the article and posted a list of questions that they said they would go through systematically to help clear up confusion. To the best of our knowledge, they never addressed any of the questions. Below are the questions, as well as our response to some of the issues raised: List of questions posed by Triton (click here to go to one of the forums in which the discussion took place): “First i would like to ask you Randy and Craig, do you have access to a ICP-OES of the newst generation approx 4 years old ( like ours ) without any restriction to use it ? Don´t get me wrong , I am asking because of the possiblility to experimentaly try some stuff that possibly will come up in the discussion , as we work very practical in that point. Otherwise in some points we will only be able to go by scientific papers , wich in a practical way will not help to much. In my opinion the Article is mixing up a lot of things that we should saperate from each other, to not let the discussion get caotic ( like the article ). I can filter following questions out of all that have been said in the article and here : 1. Is TRITON ICP-OES testing PRODUCT good and helpfull for practical reefkeeping ( hobby or public aquaria ), is there a Value to the testing for this purpose. ( Fit for Purpose discussion ) by all informations we have right now ( Article and reality ) ? 2. Is TRITON ICP-OES testing PRODUCT good and helpfull for any other purpose like academic or scientific publications or a legal survey on court … ? 3. How has TRITON managed to overcome the problems coming with ICP-OES testing of seawater and why is that possible as cheap or at all ? 4. Do the guys from TRITON know what they do ? 5. What does the DATA in the Article realy tell us and wich value does it have for the Reefkeeper, also how much weight does it have acording to the Fit for purpose discussion ? 6. Is there anything that can make the customers of TRITON feel more confident with the testing ? is there any need to feel more confident with TRITON ? what would be the best way to get this confidence ( from the viwe of the reefkeeper )? 7. How accurate / precise is TRITON TESTING PRODUCT and how accurate /precise, for wich purpose it need to be ? 8. Chemical geek questions like is Iodine testing effected by acid ? wich elements will be effected by acid ? in detail wich sideeffects will bacteria, (nano)particles, Matrix diviations/variations… have on the testing. 9. Is there any way that the TRITON TEST PRODUCT user wll be able to determine the accuracy / precision in his own personal TEST matrix ? I think by going trough a planed discussion like that all of us would be able to contribute better, and the information for the audience will be more informativ. Please feel free to add anything i could have missed. I will chime in and start with the first question then. sorry for the bad english. All the best Ehsan” Our response to issues raised about the article (click here to go one of the forums where the discussion took place): “Thanks everyone for the discussion so far. Both here and other venues we have been assured that the idea of legal action is currently a non-worry. For this we are thankful. We are concerned about some of the motivations that Ehsan has been attributing to the article and its authors, as they are not accurate. We have do not have anything against Triton, we do not have something against Ehsan’s family, we are not planning on setting up a competing business, and we no reason to try to skew the results in any particular way (all of these accusations have been said by Ehsan in various places). Both of the authors have careers that they aren’t planning on giving up, and neither of the authors have any interest or anything to gain by doing something that could tarnish their own reputations. There is no intent to ‘gotcha’ anyone, to fool anyone, to use percentages in confusing or misleading manner, to manipulate data, and we don’t feel the article is disparaging to Triton. Perhaps there is the issue with Ehsan’s English combined with his trying to protect his company that helped him post things he may not have meant – we are going to hope that this is the case. The point of the article was to discuss the issues of ICP-OES and saltwater, explore some of the questions about how Triton is addressing those issues, and to present data from the certified reference material we sent to Triton to give a snapshot of the precision and accuracy of the testing. As we said in the article: fast, inexpensive, accurate and precise testing of saltwater would be fantastic for many reasons. We were pleasantly surprised at how well Triton Lab actually tested out in regards to the certified reference material. We are also quite surprised at some of the negative reactions to the article. For instance, reference after reference, as well as expert after expert, indicates that 2% nitric acid will have negligible effects on the testing results in both radial and axial ICP-OES. The acidification of samples is simply not an issue for any other ICP-OES analyst besides Triton. Triton has not provided any evidence as to why it is a problem for their testing, they just say it is a problem. This is unconvincing. The results we published seem in reality not bad for Triton, so I am unsure why the push is there to discredit them. Discussion about potential problems with the reference material itself are confusing as HPS makes these reference materials to be used exactly the way it was used in the article. Why should we trust that company supplying the reference material more than Triton Lab (at least at this point)? Because many labs around the world use HPS for a great many things, HPS always under intense scrutiny, and HPS offer’s a certified reference material. Triton is currently a private lab with no external oversight or corroboration. Again, the results published in the article seem not bad for Trition, so I am unsure why the push is there to discredit those results or the HPS reference material. It has also been said that the certified reference material in 2% nitric acid is not seawater, and that Triton Lab only tests seawater. This makes little sense to us, as it seems no hobbyist is sending Triton Lab actual seawater, but artificial salt water that may contain any manner of unknown constituents that could impact testing in any number of unknown ways. In the sense that all hobbyist samples are ‘sea water’, so is the reference material we sent to Triton, the only difference is that the reference material has been stabilized with 2% nitric acid (which has been shown to have negligible effects on this type of testing). Again, the test results seem not bad for Triton, so the push to discredit the results seems strange. Furthermore, Triton representatives themselves contacted HPS to inquire as to any issues with running a 2% nitric acid matrix despite non-acidic calibration standards; the HPS personnel corroborated the statements we made in our article. Some of the discussion about the realities and practicalities of the acidification of samples also seem without support; such acidification is not difficult, nor dangerous. It has been said in several places that a 2% nitric acid solution of 100l has 2l of acid in it – as if this is a thing to be scared of. However, the two percent nitric acid refers to the weight percent, not volume percent. The density of 2% nitric acid at 25°C is 1.00778 kg/L. Two percent of this, by weight, is 0.0201556 kg, and is the mass of pure nitric acid in one liter of solution. Multiply this mass of pure nitric acid by 100, and you get 2.01556 kg total, the mass of pure nitric acid in 100 liters of 2% nitric acid. Pure nitric acid has density of 1.504 kg per liter. Thus, dividing 2.01556 by 1.504 informs you that a 100 L aquarium of 2% nitric acid in fact contains 1.34 L of actual nitric acid. These types of calculations, and comprehension of the difference between weight percent and volume percent, are a critical component of the most basic understanding of analytical chemistry and are crucial when reporting testing results – which makes us nervous about other shortcuts that may be used in Triton Lab calculations or methodology. It doesn’t seem Ehsan has formal chemistry training, so perhaps the need for such attention has not been sufficiently instilled in him, but they are very important – there is a big difference between 1.34 and 2. Almost more important, saying there is “2 liters” of acid sounds really scary – but that “2 liters” is mixed with 98 liters of other stuff, and it isn’t going to jump out of solution and give you acid burns. As Craig Bingman pointed out, the personal protection equipment that is standard for handling a solution of 2% nitric acid is exactly the same as for saltwater or seawater. We are also worried about the discussion of personal protective equipment in the Triton Lab. Ehsan writes “… and for sure lab coat, protective eyewear and gloves and all kinds of needed signs and declaretions…. ( safity is very important, and german government is very strict in that point ). Just to let you know all Pics on the webpage are original pictures of our facilities, not “faked buyed ones” . and even the hands on them are my hands” However the photos linked to support how much safety is important show lab work being performed without a lab coat or gloves (eyes are not shown in the pictures), which leaves us with a feeling of confusion – does Triton lab use PPE or not? They didn’t use any PPE while doing testing at MACNA. PPE are important for any lab work for both the safety of the lab technician as well as to ensure the integrity of the samples. Since the article appeared in the Skeptical Reefkeeping series, we feel that it is important to bring up the idea of Trust and the ‘proof is in the pudding’ ideas that have come up in discussions of the article. Trust is a difficult one for everyone. Anyone selling you anything says ‘trust me’, and given how many times people have been misled by such trust we need to be careful. There is a list of products for reefkeeping as long as my leg that have told us to trust them, however, upon closer scrutiny, it turns out that that trust was unwarranted. It isn’t that we are saying that Ehsan is not trustable, rather that other evidence to support his claims would make him more trustable. The idea that the proof is in the pudding – how wonderful the Triton aquarium looks – has nothing to do with the article about Triton Lab testing. There are a million ways to run a reef tank and a lot of them work and create amazing results. The article looks at the testing methods, precision and accuracy of the test results and specifically says nothing about how those values should be used or the Triton aquarium methodology because we simply do not know if something like elevated lithium is problematic in tank water or in a commercial salt mix. Another idea that has come up several times in several places is that people should go to Triton Lab in Germany so they can see for themselves what is being done. This seems confusing and unnecessary for customers to spend time and money to travel to become comfortable with testing methodology when that information could easily be supplied in writing. We think a real discussion might be helpful and needs to start with Ehsan answering some of the questions he posed in his list in a straightforward manner, with some support besides ‘trust me’. Or, he could say ‘the data in the article shows pretty much what we have been saying all along, and gives people a independent way to understand the test results they get from Triton’. Finally, we hope that Ehsan takes all of this in the neutral spirit intended – to continue discussion and share and develop knowledge and understanding. Rich and Chris” Here is another forum in which such discussion took place.