How can I read binary file in Tensorflow

Question

I'm trying to read binary file in tensorflow. I want to ask, which method should I use, and how for reading binary file. In tensorflow, they recommends use dataset in tf.data. But I can't find simple example of using dataset, especially FixedLengthRecordDataset. I think I should use this method, but I don't know how to use.

[hg file] := [file header] [image1] [image2] [image3] ...

[file header] := "hg  " (8 bytes)

[imageN] := [image header] [image data]

[image header] := [code(2 bytes)] [width (1 byte)] [height(1 byte)] [reserved(2 bytes)]

[image data] := 256 gray data (width * height bytes, row-major format)

This is the format of my binary file.

Please give me some advice for this work.

EDIT : All images have different size. So maybe I can't use FixedLengthRecordDatasest. I think I have to convert all images to same size of dataset

Allen Lavoie · Accepted Answer · 2018-02-26 23:50:14Z

1

I believe you'd need to write your own Dataset reader op to parse that format. FixedLengthRecordDataset's implementation would be a good place to start for structuring the code (but as you note, the records you've described are not fixed length).

I would recommend instead re-encoding the images in tf.train.Example protocol buffers, then using a TFRecordDataset for input. That way the parsing is already written for you; you should be able to create tf.train.Example protos in any language.

answered Feb 26, 2018 at 23:50

Allen Lavoie

5,8081 gold badge20 silver badges26 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

How can I read binary file in Tensorflow

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related