是否有任何允許數據庫轉儲在INSERT INTO
語句中包含列名的SQLite命令或第三方工具?帶列名的SQLite導出
而不是
INSERT INTO "MyTable" VALUES ('A', 'B');
我想看到
INSERT INTO "MyTable" (Column1, Column2) VALUES ('A', 'B');
SQLite中的.dump
命令只提供了第一個版本。
是否有任何允許數據庫轉儲在INSERT INTO
語句中包含列名的SQLite命令或第三方工具?帶列名的SQLite導出
而不是
INSERT INTO "MyTable" VALUES ('A', 'B');
我想看到
INSERT INTO "MyTable" (Column1, Column2) VALUES ('A', 'B');
SQLite中的.dump
命令只提供了第一個版本。
我簡要介紹了源代碼。我沒有看到任何明顯的方式來做到這一點。但我鞭打了一個快速而髒的awk腳本來插入列名。
開頭此轉儲:
PRAGMA foreign_keys=OFF;
BEGIN TRANSACTION;
CREATE TABLE test (test_id int primary key, test_name varchar(35));
INSERT INTO "test" VALUES(1,'Wibble');
INSERT INTO "test" VALUES(2,'Wobble');
INSERT INTO "test" VALUES(3,'Pernicious');
COMMIT;
我跑這個awk腳本
/CREATE TABLE/ {
# Extract the part between parens. This part contains the
# column definitions.
first_col = match($0, /\(.*\)/);
if (first_col) {
num_columns = split(substr($0, RSTART + 1, RLENGTH), a, ",");
for (i = 1; i <= num_columns; i++) {
sub(/^ /, "", a[i]);
split(a[i], names, " ");
column_names[i] = names[1];
}
}
}
/INSERT INTO \"[A-Za-z].*\"/ {
insert_part = match($0, /INSERT INTO \"[A-Za-z].*\"/);
printf("%s ", substr($0, RSTART, RLENGTH));
printf("(");
for (j = 1; j <= num_columns; j++) {
if (j == 1) {
printf("%s", column_names[j]);
}
else {
printf(", %s", column_names[j]);
}
}
printf(") ");
values_part = substr($0, RLENGTH+1, length($0) - RSTART);
printf("%s\n", values_part);
}
這給了我這個輸出。
INSERT INTO "test" (test_id, test_name) VALUES(1,'Wibble');
INSERT INTO "test" (test_id, test_name) VALUES(2,'Wobble');
INSERT INTO "test" (test_id, test_name) VALUES(3,'Pernicious');
讓我再來看看這個。
將列名和INSERT語句轉儲到文件。
sqlite> .output test.data
sqlite> pragma table_info(test);
sqlite> .dump test
sqlite> .quit
$ cat test.data
0|test_id|int|0||1
1|test_name|varchar(35)|0||0
PRAGMA foreign_keys=OFF;
BEGIN TRANSACTION;
CREATE TABLE test (test_id int primary key, test_name varchar(35));
INSERT INTO "test" VALUES(1,'Wibble');
INSERT INTO "test" VALUES(2,'Wobble');
INSERT INTO "test" VALUES(3,'Pernicious');
COMMIT;
現在運行這個awk腳本
/\|/ {
split($0, col_name, "|");
column_names[++n] = col_name[2];
}
/INSERT INTO \"[A-Za-z].*\"/ {
insert_part = match($0, /INSERT INTO \"[A-Za-z].*\"/);
printf("%s ", substr($0, RSTART, RLENGTH));
printf("(");
for (i = 1; i <= n; i++) {
if (i == 1) {
printf("%s", column_names[i]);
}
else {
printf(", %s", column_names[i]);
}
}
printf(") ");
values_part = substr($0, RLENGTH+1, length($0) - RSTART);
printf("%s\n", values_part);
}
而我們得到
$ awk -f dump_with_col_names.awk test.data
INSERT INTO "test" (test_id, test_name) VALUES(1,'Wibble');
INSERT INTO "test" (test_id, test_name) VALUES(2,'Wobble');
INSERT INTO "test" (test_id, test_name) VALUES(3,'Pernicious');
我創造了這個shell腳本:
#!/bin/sh
SQLITE=sqlite3
if [ -z "$1" ] ; then
echo usage: $0 sqlite3.db
exit
fi
DB="$1"
TABLES=`"$SQLITE" "$DB" .tables`
echo "-- $TABLES"
echo 'BEGIN TRANSACTION;'
for TABLE in $TABLES ; do
echo
echo "-- $TABLE:";
COLS=`"$SQLITE" "$DB" "pragma table_info($TABLE)" |
cut -d'|' -f2 `
COLS_CS=`echo $COLS | sed 's/ /,/g'`
echo -e ".mode insert\nselect $COLS_CS from $TABLE;\n" |
"$SQLITE" "$DB" |
sed "s/^INSERT INTO table/INSERT INTO $TABLE ($COLS_CS)/"
done
echo 'COMMIT;';
兩個問題:
個簡單python腳本做的伎倆
import sqlite3
infile="your_file.sqlite3"
table="your_table"
conn = sqlite3.connect(infile)
conn.row_factory = sqlite3.Row
c = conn.cursor()
res = c.execute("SELECT * FROM " + table)
curr_row = -1
for row in res:
curr_row += 1
if curr_row == 0:
col_names = sorted(row.keys())
s = "INSERT INTO " + table + " ("
for col_name in col_names:
s+=col_name + ","
prefix = s[:-1] + ") VALUES ("
s = ""
for col_name in col_names:
col_val = row[col_name]
if isinstance(col_val,int) or isinstance(col_val,float):
s+= str(row[col_name]) +","
else:
s+= "'" + str(row[col_name]) +"',"
print prefix,s[:-1],");"
這不能正確地轉義名稱,字符串或斑點。 – 2013-10-23 20:50:43
這裏是一個Perl的版本,與任意數量的表的工作原理:
#!/usr/bin/perl
use strict;
use warnings;
my @column_names;
my $col_reset = 1;
while(<>)
{
if (/^\d+\|/) {
if ($col_reset)
{
@column_names =();
$col_reset = 0;
}
my @col_info = split(/\|/);
push @column_names, $col_info[1];
}
if(/INSERT INTO/) {
m/(INSERT INTO \"?[A-Za-z_]+\"?) (.*)/ or die $_;
my $insert_part = $1;
my $values_part = $2;
print $insert_part." (".join(",", @column_names).") ".$values_part."\n";
$col_reset = 1;
}
}
而且我這是怎麼生成的每個表的轉儲在數據庫中:
grep 'CREATE TABLE' /tmp/school.sql.final \
| awk '{ print $3 }' \
| while read table; do
echo -e "pragma table_info($table);\n.dump $table"
done | sqlite3 school.db \
> /tmp/school.sql.final-with-table-info
另一個AWK sc ript,它直接從「sqlite3 data.db」的輸出中工作。轉儲」爲任意數量的表
它使用CREATE語句現在印有每列在其自己的行
BEGIN {
state = "default" # Used to know if we are in the middle of a table declaration
print_definitions = 1 # Wether to print CREATE statements or not
}
state == "default" && match($0, /^CREATE TABLE ([A-Za-z0-9_]+)/, a) {
tablename = a[1]
state = "definition"
if (print_definitions)
print
next
}
state == "definition" && /^);$/ {
state = "default"
if (print_definitions)
print
next
}
state == "definition" && ! (/PRIMARY/ || /UNIQUE/ || /CHECK/ || /FOREIGN/) {
if (length(columnlist [tablename]))
columnlist[tablename] = columnlist[tablename] ", "
columnlist[tablename] = columnlist[tablename] $1
if (print_definitions)
print
next
}
state == "default" && match($0, /^(INSERT INTO ")([A-Za-z0-9_]+)"(.*)$/, a) {
print a[1] a[2] "\" (" columnlist[a[2]] ")" a[3]
}
我不確定這回答了這個問題。 – Kmeixner 2016-03-04 18:37:17
路易斯L.溶液不是爲我工作的事實,所以我做了這個GAWK解決方案從sqlite3的版本轉儲測試3.8.7.1
表CREATE語句都像如
CREATE TABLE "strom" (
"id" integer NOT NULL PRIMARY KEY AUTOINCREMENT,
"otec" integer NOT NULL,
"nazev" text NOT NULL,
"ikona" text NULL,
"barva" text NULL
);
但也可能是這樣一個
CREATE TABLE "changes" (
"version" integer NOT NULL PRIMARY KEY AUTOINCREMENT,
"last_change" text NOT NULL DEFAULT (datetime('now','localtime')),
`ref` text NOT NULL,
"ref_id" text NULL,
"action" text NOT NULL
, "data" text NOT NULL DEFAULT '');
#!/usr/bin/gawk -f
# input is sqlite3 dump, tested with sqlite3 version 3.8.7.1
# output are INSERT statements including column names
# i.e. not e.g.
# INSERT INTO "changes" VALUES(1,'2016-07-19 17:46:12','cenik','10','UPDATE','');
# like in standard dump
# but
# INSERT INTO "changes" ("version", "last_change", "ref", "ref_id", "action", "data") VALUES(1,'2016-07-19 17:46:12','cenik','10','UPDATE','');
# BEGIN TRANSACTION and COMMIT are included in output
BEGIN {
state = "default" # default/definition/insert let us know wether we are in CREATE or INSERT statement
print_definitions = 0 # wether to print CREATE statements or not
}
state == "default" && match($0, /^CREATE TABLE \"([A-Za-z0-9_]+)\" *\($/, a) {
tablename = a[1]
state = "definition"
if (print_definitions)
print
next
}
state == "definition" && /^ *); *$/ {
state = "default"
if (print_definitions)
print
next
}
state == "definition" && ! (/^[\ ]{1,2}PRIMARY/ || /UNIQUE/ || /CHECK/ || /^[\ ]{1,2}FOREIGN KEY.*REFERENCES/) {
if (length(columnlist [tablename]))
columnlist[tablename] = columnlist[tablename] ", "
if (match($0, /(\".*\")/, b))
columnlist[tablename] = columnlist[tablename] b[1]
if (match($0, /`(.*)`/, c))
columnlist[tablename] = columnlist[tablename] "\""c[1]"\""
if (print_definitions)
print
}
state == "definition" && /^.*); *$/ {
state = "default"
next
}
state == "default" && match($0, /^(INSERT INTO ")([A-Za-z0-9_]+)"(.*)/, a) {
print a[1] a[2] "\" (" columnlist[a[2]] ")" a[3]
state = "insert"
if (/^.*); *$/)
state = "default"
}
state == "insert" && ! /^INSERT INTO/{
print
}
state == "insert" && /^.*); *$/ {
state = "default"
next
}
state == "default" && (/^ *BEGIN TRANSACTION;/ || /^ *COMMIT;/) {
print
}
這不回答這個問題。我在這裏寫這篇文章是因爲我正在處理類似的問題。一種方法是分別轉儲結構和數據。對於刀片像你描述的數據文件之外:
sqlite> .headers on
sqlite> .mode insert MyTable
sqlite> .output MyTable_data.sql
sqlite> select * from MyTable;
sqlite> .quit
有導入/導出從/ SQL數據源文本 數據庫信息和 導出爲CSV文本的SQLite的擴展模塊。 http://www.ch-werner.de/sqliteodbc/html/impexp_8c.html
例如在Ubuntu你的步驟是:
從ubuntu的庫中安裝模塊中源碼命令行提示運行
sudo apt install libsqlite3-mod-impexp
裝載模塊
.load libsqlite3_mod_impexp
導出數據庫t Ødump.sql文件
select export_sql('dump.sql','1');
結果例如,對於我的數據庫是
INSERT OR REPLACE INTO "camera" ("name","reviews") VALUES('BenQ GH700', NULL);
INSERT OR REPLACE INTO "camera" ("name","reviews") VALUES('Canon EOS 40D', NULL);
不幸的是,這隻能在同一時間被用於一個表,失敗,如果有一個豎線( |)在您的數據的任何地方。 – qris 2014-10-09 16:40:07