2010-11-16 40 views
18

是否有任何允許數據庫轉儲在INSERT INTO語句中包含列名的SQLite命令或第三方工具?帶列名的SQLite導出

而不是

INSERT INTO "MyTable" VALUES ('A', 'B'); 

我想看到

INSERT INTO "MyTable" (Column1, Column2) VALUES ('A', 'B'); 

SQLite中的.dump命令只提供了第一個版本。

回答

2

我簡要介紹了源代碼。我沒有看到任何明顯的方式來做到這一點。但我鞭打了一個快速而髒的awk腳本來插入列名。

開頭此轉儲:

PRAGMA foreign_keys=OFF; 
BEGIN TRANSACTION; 
CREATE TABLE test (test_id int primary key, test_name varchar(35)); 
INSERT INTO "test" VALUES(1,'Wibble'); 
INSERT INTO "test" VALUES(2,'Wobble'); 
INSERT INTO "test" VALUES(3,'Pernicious'); 
COMMIT; 

我跑這個awk腳本

/CREATE TABLE/ { 
    # Extract the part between parens. This part contains the 
    # column definitions. 
    first_col = match($0, /\(.*\)/); 
    if (first_col) { 
    num_columns = split(substr($0, RSTART + 1, RLENGTH), a, ","); 
    for (i = 1; i <= num_columns; i++) { 
     sub(/^ /, "", a[i]); 
     split(a[i], names, " "); 
     column_names[i] = names[1]; 
    } 
    } 
} 
/INSERT INTO \"[A-Za-z].*\"/ { 
    insert_part = match($0, /INSERT INTO \"[A-Za-z].*\"/); 
    printf("%s ", substr($0, RSTART, RLENGTH)); 

    printf("("); 
    for (j = 1; j <= num_columns; j++) { 
    if (j == 1) { 
     printf("%s", column_names[j]); 
    } 
    else { 
     printf(", %s", column_names[j]); 
    } 
    } 
    printf(") "); 

    values_part = substr($0, RLENGTH+1, length($0) - RSTART); 
    printf("%s\n", values_part); 

} 

這給了我這個輸出。

INSERT INTO "test" (test_id, test_name) VALUES(1,'Wibble'); 
INSERT INTO "test" (test_id, test_name) VALUES(2,'Wobble'); 
INSERT INTO "test" (test_id, test_name) VALUES(3,'Pernicious'); 
5

讓我再來看看這個。

將列名和INSERT語句轉儲到文件。

sqlite> .output test.data 
sqlite> pragma table_info(test); 
sqlite> .dump test 
sqlite> .quit 

$ cat test.data 
0|test_id|int|0||1 
1|test_name|varchar(35)|0||0 
PRAGMA foreign_keys=OFF; 
BEGIN TRANSACTION; 
CREATE TABLE test (test_id int primary key, test_name varchar(35)); 
INSERT INTO "test" VALUES(1,'Wibble'); 
INSERT INTO "test" VALUES(2,'Wobble'); 
INSERT INTO "test" VALUES(3,'Pernicious'); 
COMMIT; 

現在運行這個awk腳本

/\|/ { 
    split($0, col_name, "|"); 
    column_names[++n] = col_name[2]; 
} 
/INSERT INTO \"[A-Za-z].*\"/ { 
    insert_part = match($0, /INSERT INTO \"[A-Za-z].*\"/); 
    printf("%s ", substr($0, RSTART, RLENGTH)); 

    printf("("); 
    for (i = 1; i <= n; i++) { 
    if (i == 1) { 
     printf("%s", column_names[i]); 
    } 
    else { 
     printf(", %s", column_names[i]); 
    } 
    } 
    printf(") "); 

    values_part = substr($0, RLENGTH+1, length($0) - RSTART); 
    printf("%s\n", values_part); 


} 

而我們得到

$ awk -f dump_with_col_names.awk test.data 
INSERT INTO "test" (test_id, test_name) VALUES(1,'Wibble'); 
INSERT INTO "test" (test_id, test_name) VALUES(2,'Wobble'); 
INSERT INTO "test" (test_id, test_name) VALUES(3,'Pernicious'); 
+0

不幸的是,這隻能在同一時間被用於一個表,失敗,如果有一個豎線( |)在您的數據的任何地方。 – qris 2014-10-09 16:40:07

3

我創造了這個shell腳本:

#!/bin/sh 

SQLITE=sqlite3 

if [ -z "$1" ] ; then 
     echo usage: $0 sqlite3.db 
     exit 
fi 

DB="$1" 

TABLES=`"$SQLITE" "$DB" .tables` 
echo "-- $TABLES" 
echo 'BEGIN TRANSACTION;' 

for TABLE in $TABLES ; do 
     echo 
     echo "-- $TABLE:"; 
     COLS=`"$SQLITE" "$DB" "pragma table_info($TABLE)" | 
     cut -d'|' -f2 ` 
     COLS_CS=`echo $COLS | sed 's/ /,/g'` 
     echo -e ".mode insert\nselect $COLS_CS from $TABLE;\n" | 
     "$SQLITE" "$DB" | 
     sed "s/^INSERT INTO table/INSERT INTO $TABLE ($COLS_CS)/" 
done 
echo 'COMMIT;'; 

兩個問題:

  1. 表和cols必須有 '正常' 的名字(即 α-NUM下劃線),
  2. 數據不能包含字符串 '\ n插入INTO 表'。
-2

簡單python腳本做的伎倆

import sqlite3 
infile="your_file.sqlite3" 
table="your_table" 

conn = sqlite3.connect(infile) 
conn.row_factory = sqlite3.Row 

c = conn.cursor() 
res = c.execute("SELECT * FROM " + table) 
curr_row = -1 

for row in res: 
    curr_row += 1 
    if curr_row == 0: 
     col_names = sorted(row.keys()) 
     s = "INSERT INTO " + table + " (" 
     for col_name in col_names: 
     s+=col_name + "," 
     prefix = s[:-1] + ") VALUES (" 

    s = "" 
    for col_name in col_names: 
    col_val = row[col_name] 
    if isinstance(col_val,int) or isinstance(col_val,float): 
     s+= str(row[col_name]) +"," 
    else: 
     s+= "'" + str(row[col_name]) +"'," 
    print prefix,s[:-1],");" 
+2

這不能正確地轉義名稱,字符串或斑點。 – 2013-10-23 20:50:43

2

這裏是一個Perl的版本,與任意數量的表的工作原理:

#!/usr/bin/perl 

use strict; 
use warnings; 

my @column_names; 
my $col_reset = 1; 

while(<>) 
{ 
    if (/^\d+\|/) { 
    if ($col_reset) 
    { 
     @column_names =(); 
     $col_reset = 0; 
    } 
    my @col_info = split(/\|/); 
    push @column_names, $col_info[1]; 
    } 

    if(/INSERT INTO/) { 
    m/(INSERT INTO \"?[A-Za-z_]+\"?) (.*)/ or die $_; 
    my $insert_part = $1; 
    my $values_part = $2; 
    print $insert_part." (".join(",", @column_names).") ".$values_part."\n"; 
    $col_reset = 1; 
    } 
} 

而且我這是怎麼生成的每個表的轉儲在數據庫中:

grep 'CREATE TABLE' /tmp/school.sql.final \ 
| awk '{ print $3 }' \ 
| while read table; do 
    echo -e "pragma table_info($table);\n.dump $table" 
done | sqlite3 school.db \ 
> /tmp/school.sql.final-with-table-info 
0

另一個AWK sc ript,它直接從「sqlite3 data.db」的輸出中工作。轉儲」爲任意數量的表

它使用CREATE語句現在印有每列在其自己的行

BEGIN { 
     state = "default" # Used to know if we are in the middle of a table declaration 
     print_definitions = 1 # Wether to print CREATE statements or not 
} 

state == "default" && match($0, /^CREATE TABLE ([A-Za-z0-9_]+)/, a) { 
     tablename = a[1] 
     state = "definition" 
     if (print_definitions) 
       print 
     next 
} 

state == "definition" && /^);$/ { 
     state = "default" 
     if (print_definitions) 
       print 
     next 
} 

state == "definition" && ! (/PRIMARY/ || /UNIQUE/ || /CHECK/ || /FOREIGN/) { 
     if (length(columnlist [tablename])) 
       columnlist[tablename] = columnlist[tablename] ", " 
     columnlist[tablename] = columnlist[tablename] $1 
     if (print_definitions) 
       print 
     next 
} 

state == "default" && match($0, /^(INSERT INTO ")([A-Za-z0-9_]+)"(.*)$/, a) { 
     print a[1] a[2] "\" (" columnlist[a[2]] ")" a[3] 
} 
+0

我不確定這回答了這個問題。 – Kmeixner 2016-03-04 18:37:17

0

路易斯L.溶液不是爲我工作的事實,所以我做了這個GAWK解決方案從sqlite3的版本轉儲測試3.8.7.1

表CREATE語句都像如

CREATE TABLE "strom" (
    "id" integer NOT NULL PRIMARY KEY AUTOINCREMENT, 
    "otec" integer NOT NULL, 
    "nazev" text NOT NULL, 
    "ikona" text NULL, 
    "barva" text NULL 
); 

但也可能是這樣一個

CREATE TABLE "changes" (
    "version" integer NOT NULL PRIMARY KEY AUTOINCREMENT, 
    "last_change" text NOT NULL DEFAULT (datetime('now','localtime')), 
    `ref` text NOT NULL, 
    "ref_id" text NULL, 
    "action" text NOT NULL 
, "data" text NOT NULL DEFAULT ''); 

#!/usr/bin/gawk -f 

# input is sqlite3 dump, tested with sqlite3 version 3.8.7.1 
# output are INSERT statements including column names 
# i.e. not e.g. 
# INSERT INTO "changes" VALUES(1,'2016-07-19 17:46:12','cenik','10','UPDATE',''); 
# like in standard dump 
# but 
# INSERT INTO "changes" ("version", "last_change", "ref", "ref_id", "action", "data") VALUES(1,'2016-07-19 17:46:12','cenik','10','UPDATE',''); 
# BEGIN TRANSACTION and COMMIT are included in output 

BEGIN { 
     state = "default" # default/definition/insert let us know wether we are in CREATE or INSERT statement 
     print_definitions = 0 # wether to print CREATE statements or not 
} 

state == "default" && match($0, /^CREATE TABLE \"([A-Za-z0-9_]+)\" *\($/, a) { 
     tablename = a[1] 
    state = "definition" 
     if (print_definitions) 
       print 
     next 
} 

state == "definition" && /^ *); *$/ { 
     state = "default" 
     if (print_definitions) 
       print 
     next 
} 

state == "definition" && ! (/^[\ ]{1,2}PRIMARY/ || /UNIQUE/ || /CHECK/ || /^[\ ]{1,2}FOREIGN KEY.*REFERENCES/) { 
     if (length(columnlist [tablename])) 
       columnlist[tablename] = columnlist[tablename] ", " 
     if (match($0, /(\".*\")/, b)) 
     columnlist[tablename] = columnlist[tablename] b[1] 
    if (match($0, /`(.*)`/, c)) 
     columnlist[tablename] = columnlist[tablename] "\""c[1]"\"" 
     if (print_definitions) 
       print 
} 

state == "definition" && /^.*); *$/ { 
     state = "default" 
     next 
} 

state == "default" && match($0, /^(INSERT INTO ")([A-Za-z0-9_]+)"(.*)/, a) { 
     print a[1] a[2] "\" (" columnlist[a[2]] ")" a[3] 
    state = "insert" 
    if (/^.*); *$/) 
     state = "default" 
} 

state == "insert" && ! /^INSERT INTO/{ 
    print 
} 

state == "insert" && /^.*); *$/ { 
     state = "default" 
    next 
} 

state == "default" && (/^ *BEGIN TRANSACTION;/ || /^ *COMMIT;/) { 
    print 
} 
0

這不回答這個問題。我在這裏寫這篇文章是因爲我正在處理類似的問題。一種方法是分別轉儲結構和數據。對於刀片像你描述的數據文件之外:

sqlite> .headers on 
sqlite> .mode insert MyTable 
sqlite> .output MyTable_data.sql 
sqlite> select * from MyTable; 
sqlite> .quit 
0

有導入/導出從/ SQL數據源文本 數據庫信息和 導出爲CSV文本的SQLite的擴展模塊。 http://www.ch-werner.de/sqliteodbc/html/impexp_8c.html

例如在Ubuntu你的步驟是:

  1. 從ubuntu的庫中安裝模塊中源碼命令行提示運行

    sudo apt install libsqlite3-mod-impexp 
    
  2. 裝載模塊

    .load libsqlite3_mod_impexp 
    
  3. 導出數據庫t Ødump.sql文件

    select export_sql('dump.sql','1'); 
    
  4. 結果例如,對於我的數據庫是

    INSERT OR REPLACE INTO "camera" ("name","reviews") VALUES('BenQ GH700', NULL); 
    INSERT OR REPLACE INTO "camera" ("name","reviews") VALUES('Canon EOS 40D', NULL);