Skip to content

readDouble is off by 1-7 ULP; subnormals parse as 0 #218

Description

@skymanbp

Both double readers (bytestring-lexing and Data.Text.Read.double) are
approximate: 81% of a 200k show/read sample comes back 1-7 ULP off,
subnormals parse as 0.0, and the largest finite double parses as
Infinity.

An exact byte-level conversion with a Clinger fast path fixes all
three, but this is the parsing hot path (#214 review), so it'll come as
its own PR with benchmarks.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions