uploading large amount of data to mysql

[c-chan]

---

mangutana ta ko ba. kai mag upload man gud mi ug dagko kayu nga files sa mysql namu. lampas 10mb ba. nya ang mysql kai mag error na, so di ma upload. namaoi ika suggest nga way para maka upload mi? sa online ni siya :>

thank you.

[nullpointer]

maybe you need to split your data to smaller ones...

[psyd_1]

mangutana ta ko ba. kai mag upload man gud mi ug dagko kayu nga files sa mysql namu. lampas 10mb ba. nya ang mysql kai mag error na, so di ma upload. namaoi ika suggest nga way para maka upload mi? sa online ni siya :>

thank you.

pwed nimu manu-manuhon (mannually) ug insert ug smaller chunks

or

why not write a simple program na mu hinay2x ug insert sa imung mga data

[c-chan]

@nullpointer:waaa...split the data? what if i have millions of data nya ang ma upload ra everytime mag upload mi is 2000 rows. dugay kayu mahuman.
T^T

@psyd_1: what do you mean "program na mu hinay2x ug insert sa imung mga data " pwede explain further ni? like unsai flow? :3

[nullpointer]

if you can't afford to split your data, then you try to edit your mysql configuration in your server if you're allowed...

....is your upload process automated or manual?...if its automated then you can modify your program/script to able to upload your data by chunks(allowed by your server)...

[ErapGuapo]

unsa man nga data imo e-upload??

[dodie]

mangutana ta ko ba. kai mag upload man gud mi ug dagko kayu nga files sa mysql namu. lampas 10mb ba. nya ang mysql kai mag error na, so di ma upload. namaoi ika suggest nga way para maka upload mi? sa online ni siya :>

thank you.

You can simply use TELNET (command prompt) to connect to your website. If your domain supports telnet. This way you can execute large sql files without limitations *EVIL LAUGH*.


To test it locally, you can simply use MYSQL> command prompt syntax:

mysql >  USE dakudatabase;
mysql >  source  c:\folder\folder\largefile.sql

Online domain using TELNET (based on LINUX server)

mysql >  USE dakudatabase;
mysql >  source  /www/folder/folder/largefile.sql

[psyd_1]

@psyd_1: what do you mean "program na mu hinay2x ug insert sa imung mga data " pwede explain further ni? like unsai flow? :3

write a program
1. connect to the db
2. handshake

the loop these steps until finished
3. try inserting
4. if fails rollback and separate those chunks with probs (store ba ron nimu somewhere as file)

deal sa mga files sa #4 after done naka sa insertions sa tanan.
you might wanna invetigate what's the cause sa probs sa #4

[c-chan]

@ sir ErapGuapo: company-related data(sakto bani nga answer?)

@psyd_1: is this the same as using bigdump?

@ sir dodie: is that possible if your host is yahoo?
and is there a step-by-step tutorial that would help me achieve my goal? what specific softwares should i download? i've done some research and downloaded PUTTY but i still don't know how to use it.

thank you.

[nullpointer]

do you have ssh access?