如何獲取圖像格式的ILSVRC12數據或如何創建ilsvrc12_val_lmdb？

Question

我想在Caffe中運行imagenet示例。在這個（https://github.com/BVLC/caffe/tree/master/examples/imagenet）頁面他們說

We assume that you already have downloaded the ImageNet training data and validation data, and they are stored on your disk like: 

/path/to/imagenet/train/n01440764/n01440764_10026.JPEG 
/path/to/imagenet/val/ILSVRC2012_val_00000001.JPEG 

我在哪裏可以找到這些數據？

Answer 1

這是一個過程。
1.到imagenet's download頁面，選擇「下載圖片網址」。
2.從頁面底部的鏈接下載圖片URL列表，例如fall 2011's list。
3.從網址下載圖片（這可能需要幾天）。

請注意，某些網址（上次檢查時約5％）不再有效，並且會返回一個「存根」flickr圖片。

下面是使用convert utility一個Perl腳本，我用來下載圖片：

#!/usr/bin/perl 

use strict; 
use warnings; 
use Digest::MD5 qw(md5_hex); 
use File::Copy; 

my $base = "/path/to/imagenet/train/"; 

open my $fh, '/path/to/train_image_urls.txt' or die "Cannot not open url list: $!"; 
while(my $line = <$fh>) { 
    # a line in the url list looks like: 
    # n00005787_13 http://www.powercai.net/Photo/UploadPhotos/200503/20050307172201492.jpg 
    chomp($line); 
    if ($line =~ /^(n\d+)_(\d+)\s+(\S.+)$/) { 
     my $type = $1; 
     my $filename = $1 . "_" . $2; 
     my $url = $3; 
     my $dst = "$base/$type/$filename" . ".JPEG"; 
     if (! -d $base.$type) { 
     mkdir($base.$type) 
     } 
     my $convertCmd = "convert \"$url\" $dst"; 
     if (system($convertCmd) == 0) { 
     if (-e $dst) { 
      my $size = -s $dst; 
      # check that image is not a "flickr" stub: 
      if ($size == 24921 || $size == 6898) { 
       open(my $FILE, $dst); 
       binmode($FILE); 
       my $md5sum = Digest::MD5->new->addfile($FILE)->hexdigest; 
       if ($md5sum eq "513dd080b92472dab22ad3e09f58f1af" || $md5sum == "ed15d4fe8b5680d1b3e01c0d2778d145") { 
       print $invl "$dst\n"; 
       move($dst, $base . "../invalid/"); 
       } 
       close($FILE); 
      } 
     } 
     } else { 
     # invalid image file 
     } 
    } else { 
     # error downloading an image 
    } 
} 
close $fh; 
exit(0);