| Safe Haskell | None |
|---|---|
| Language | Haskell2010 |
DataFrame.Internal.Utf8
Description
UTF-8 validation and decodeUtf8Lenient-parity slice decoding used by
ColumnBuilder to turn shared byte buffers into Text.
Synopsis
- isValidUtf8Slice :: Array -> Int -> Int -> Bool
- isUtf8Boundary :: Word8 -> Bool
- lenientDecodeSlice :: Array -> Int -> Int -> Text
- sliceTextVector :: Array -> Vector Int -> Vector Text
Documentation
isValidUtf8Slice :: Array -> Int -> Int -> Bool Source #
Whether len bytes starting at off are well-formed UTF-8.
isUtf8Boundary :: Word8 -> Bool Source #
Whether a byte may start a code point (i.e. is not a continuation byte). Field slices of a valid buffer are themselves valid iff every field starts on a boundary.