Skip to content

Glossary

TruthFinder

TruthFinder is a research method that iteratively relates source trustworthiness to the credibility of conflicting claims.

Truth discovery

TruthFinder is a named approach from research on conflicting web information. It starts from the observation that trustworthy sources tend to provide credible claims, while claims supported by trustworthy sources in turn inform estimates of source trustworthiness. The method uses this mutual relation iteratively. It also considers relationships among values rather than treating every distinct string as wholly unrelated.

The approach illustrates an important practical distinction from raw voting: a claim's support depends on who reports it, while source trust is inferred from its broader claim history. Before applying that idea, claims need a common subject and property, and source identities must be meaningful. Copying, time changes and sparse coverage can still distort the apparent pattern of agreement.

For a defensible record, TruthFinder is a model whose assumptions and outputs require inspection, not an authority that can certify a value. The original claims and sources must remain available so a reviewer can understand a high-ranked result. Its relation to source reliability is reciprocal; its relation to majority voting is that it assigns unequal evidential weight to sources.

Example

For Halden Therapeutics AG (fictional), a filing and several copied directories disagree on a status; a trust-weighted ranking differs from a page count.

The mechanism in plain terms

TruthFinder, introduced by Yin, Han and Yu in 2007, rests on a heuristic that can be stated in two sentences. A claim is likely to be true if it is reported by trustworthy sources. A source is trustworthy if the claims it reports are likely to be true. The method turns this into a computation by starting every source at the same trust score, scoring each claim from the scores of the sources that report it, and then recomputing each source's trust as the average score of its claims, repeating until the scores stop changing.

Two refinements distinguish it from a plain recurrence. It accounts for the influence of related values: if one source reports a book's author as one spelling and another as a close variant, the first lends some support to the second instead of competing with it. And it allows for a dampening factor, so that several weakly trusted sources do not combine into an implausibly confident claim. The original paper was evaluated on conflicting book-author listings from online booksellers, a domain where the facts are simple and the sources numerous, which is worth remembering when applying it to harder properties.

Where its assumptions break

The first weakness is that agreement is rewarded whether or not it is independent. A group of sources that copy a single wrong value will give it a high score and then earn high trust from having reported it, so that copying is rewarded twice. The follow-up literature, including work on source dependence, builds on exactly this limitation. The second weakness is that a single trust score per source ignores the fact that reliability varies by property. The third is the starting point: because all sources begin equal, an early majority of copies can steer the iteration toward a self-consistent but wrong fixed point.

TruthFinder also assumes that one value is true for each property. For multivalued properties, such as the inventors of a patent or the countries in which a trial recruits, that assumption forces a choice where several answers are right. The survey by Li and colleagues compares TruthFinder with later methods on these dimensions and is the best single source for choosing among them.

How to use it as a comparison point

For a reference catalogue, TruthFinder is most useful as a named baseline. Run it beside majority voting on a sample with known answers, and look specifically at the cases where the two disagree: those are the cases in which weighting sources made a difference, and they are the cases to review by hand. If it never disagrees with voting on the data in question, the sources are probably too uniform for weighting to matter. If it disagrees often, inspect whether the disagreements are driven by copying, which suggests moving to a method that models it. The article on testing truth-discovery algorithms before choosing one describes a protocol for this comparison.

Related terms and boundaries

TruthFinder is one point in a long line of methods. Majority voting is its simpler predecessor; the models that account for source dependence are its successors; and the Dawid–Skene model applies a similar alternating estimate to categorical labels from annotators. Large-scale systems that extract facts automatically add a further layer, separating the error of the extractor from the error of the source, as in Knowledge-Based Trust. For a reference catalogue the lesson is the shape of the argument and not the formula: trust and credibility are estimated together, and both estimates need independent checks.

Checks a reviewer can run

Run it beside majority voting on a sample with known answers and read the disagreements. Ask how many iterations were run and whether the result is stable to the starting trust values. Check whether any group of sources that copy each other gained trust from agreeing with itself. Ask how multivalued properties were handled.

Common misreadings

  • Treating an algorithm's rank as proof of truth.
  • Ignoring copied sources.
  • Applying the method before entity and time alignment.

Found an error on this page? See corrections for what counts as one, how to report it and the dated log.

Enquiry

Where does "TruthFinder" bear on a decision of yours?

This entry sits under truth discovery. If a decision in your organization turns on it, send the entity concerned, the sources you fuse to describe it and who may read which of them. We reply with what a first record would cover.

Or write to [email protected] in your own words.