在tensorflow教程「UTF-8」解碼錯誤

我運行到哪裏，當我運行在tensorflow教程「UTF-8」解碼錯誤

from tensorflow.examples.tutorials.mnist import input_data 

    mnist = input_data.read_data_sets('/home/fqiao/development/MNIST_data/', one_hot=True)

這個奇怪的問題，我得到：

File "<stdin>", line 1, in <module> 
    File "/usr/local/lib/python3.5/dist-packages/tensorflow/examples/tutorials/mnist/input_data.py", line 199, in read_data_sets 
    train_images = extract_images(local_file) 
    File "/usr/local/lib/python3.5/dist-packages/tensorflow/examples/tutorials/mnist/input_data.py", line 58, in extract_images 
    magic = _read32(bytestream) 
    File "/usr/local/lib/python3.5/dist-packages/tensorflow/examples/tutorials/mnist/input_data.py", line 51, in _read32 
    return numpy.frombuffer(bytestream.read(4), dtype=dt)[0] 
    File "/usr/lib/python3.5/gzip.py", line 274, in read 
    return self._buffer.read(size) 
    File "/usr/lib/python3.5/_compression.py", line 68, in readinto 
    data = self.read(len(byte_view)) 
    File "/usr/lib/python3.5/gzip.py", line 461, in read 
    if not self._read_gzip_header(): 
    File "/usr/lib/python3.5/gzip.py", line 404, in _read_gzip_header 
    magic = self._fp.read(2) 
    File "/usr/lib/python3.5/gzip.py", line 91, in read 
    self.file.read(size-self._length+read) 
    File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/platform/default/_gfile.py", line 45, in sync 
    return fn(self, *args, **kwargs) 
    File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/platform/default/_gfile.py", line 199, in read 
    return self._fp.read(n) 
    File "/usr/lib/python3.5/codecs.py", line 321, in decode 
    (result, consumed) = self._buffer_decode(data, self.errors, final) 
UnicodeDecodeError: 'utf-8' codec can't decode byte 0x8b in position 1: invalid start byte

但是，如果我只是運行的代碼在input_data.py直接，一切似乎都很好：

>>> dt = numpy.dtype(numpy.uint32).newbyteorder('>') 
>>> f = tf.gfile.Open('/home/fqiao/development/MNIST_data/train-images-idx3-ubyte.gz', 'rb') 
>>> bytestream = gzip.GzipFile(fileobj=f) 
>>> testbytes = numpy.frombuffer(bytestream.read(4), dtype=dt)[0] 
>>> testbytes 
2051

任何人有任何想法是怎麼回事？

我的系統：Ubuntu 15.10 x64 python 3.5.0。

來源

2016-02-19 Cescante

似乎存在文本編碼問題，請檢查文件的文本編碼 – Cesar

該錯誤已由最近的更改555e73d解決。 MNIST文件需要用二進制「rb」模式打開，而不是隻打開文本「r」。

來源

2016-02-20 01:56:27 Cescante

就我而言，問題出在數據文件的編碼上。

打開使用vim並執行該文件：

:set fileencoding=utf-8

這解決了問題，在我的情況。

來源

2016-12-28 13:27:40 wael34218

在tensorflow教程「UTF-8」解碼錯誤

回答

相關問題