Electronics & Programming

develissimo

Open Source electronics development and programming

  • You are not logged in.

#1 June 14, 2010 04:15:12

Jeff G.
Registered: 2009-11-02
Reputation: +  0  -
Profile   Send e-mail  

Dumping large database


I was wondering what would be the best method of trying to dump a
large database.
I am trying to migrate from postgresql to oracle, using django 1.2.1 I
have been unsucessful in using dumpdata.
It gives me a memory error. I saw one post to just try and using dump
data into several fixtures. I tried just using
dumpdata on one model in my application. This table contains around
200,000 records. That still gave me a memory error.

I saw there is still this open tickethttp://code.djangoproject.com/ticket/5423Has anyone had success with any of the patches

I would appreciate if anyone has suggestions on the best way to
migrate a large database.

Thanks,
Jeff

--
You received this message because you are subscribed to the Google Groups
"Django users" group.
To post to this group, send email to django-us...@googlegroups.com.
To unsubscribe from this group, send email to
django-users+unsubscr...@googlegroups.com.
For more options, visit this group athttp://groups.google.com/group/django-users?hl=en.

Offline

#2 June 14, 2010 08:00:47

c.
Registered: 2009-11-02
Reputation: +  0  -
Profile   Send e-mail  

Dumping large database


Hello Jeff,

I'm not familiar with postgresql but can you dump your data from
postgresql similar to what can be done with MySQL and the mysqldump
command?

On Jun 13, 8:15 pm, Jeff Green <jeffhg2...@gmail.com> wrote:

> I would appreciate if anyone has suggestions on the best way to
> migrate a large database.

Toodle-looooooooooo........
creecode

--
You received this message because you are subscribed to the Google Groups
"Django users" group.
To post to this group, send email to django-us...@googlegroups.com.
To unsubscribe from this group, send email to
django-users+unsubscr...@googlegroups.com.
For more options, visit this group athttp://groups.google.com/group/django-users?hl=en.

Offline

#3 June 14, 2010 11:34:58

David D.
Registered: 2009-11-02
Reputation: +  0  -
Profile   Send e-mail  

Dumping large database


On 14/06/10 04:15, Jeff Green wrote:I was wondering what would be the best method of trying to dump a
large database.
I am trying to migrate from postgresql to oracle, using django 1.2.1 I
have been unsucessful in using dumpdata.One interesting point - django 1.2 supports multiple connections.I believe (though haven't tried) that it should be able tosimultaneously connect to both postgresql and oracle. So with a littlepython glue, you should be able to live-copy from one db to the other,assuming you have the resources to have both dbs running at once (if youcan afford oracle, I guess you do...)I used a nasty hack job at one stage with django 1.1 to suck data frommysql (ewww) into postgresql (yay), I imagine it will be easier nowthat multiple connections are officially supported. We first triedvarious perl scripts that munge the sql-level textual dumps, but thelive copy worked better (though slower) due to the cross-databasedatatype abstraction work in django (and the goal was to use the datawith django anyway).http://docs.djangoproject.com/en/1.2/topics/db/multi-db/--
You received this message because you are subscribed to the Google Groups "Django
users" group.
To post to this group, send email to django-us...@googlegroups.com.
To unsubscribe from this group, send email to
django-users+unsubscr...@googlegroups.com.
For more options, visit this group athttp://groups.google.com/group/django-users?hl=en.

Offline

#4 June 14, 2010 15:02:06

Jeff G.
Registered: 2009-11-02
Reputation: +  0  -
Profile   Send e-mail  

Dumping large database


Actually, upgrading to 1.2 and doing a copy from one db to the other seems
like the best
option.

Thanks for the info

Jeff

On Mon, Jun 14, 2010 at 5:34 AM, David De La Harpe Golden <
david.delaharpe.gol...@ichec.ie> wrote:

> On 14/06/10 04:15, Jeff Green wrote:
>
>> I was wondering what would be the best method of trying to dump a
>> large database.
>> I am trying to migrate from postgresql to oracle, using django 1.2.1 I
>> have been unsucessful in using dumpdata.
>>
>
> One interesting point - django 1.2 supports multiple connections.
>
> I believe (though haven't tried) that it should be able to simultaneously
> connect to both postgresql and oracle. So with a little
> python glue, you should be able to live-copy from one db to the other,
> assuming you have the resources to have both dbs running at once (if you
> can afford oracle, I guess you do...)
>
> I used a nasty hack job at one stage with django 1.1 to suck data from
> mysql (ewww) into postgresql (yay), I imagine it will be easier now that
> multiple connections are officially supported. We first tried various perl
> scripts that munge the sql-level textual dumps, but the live copy worked
> better (though slower) due to the cross-database datatype abstraction work
> in django (and the goal was to use the data with django anyway).
>
>
>http://docs.djangoproject.com/en/1.2/topics/db/multi-db/>
>
> --
> You received this message because you are subscribed to the Google Groups
> "Django users" group.
> To post to this group, send email to django-us...@googlegroups.com.
> To unsubscribe from this group, send email to
> django-users+unsubscr...@googlegroups.com<django-users%2bunsubscr...@googlegroups.com>
> .
> For more options, visit this group at
>http://groups.google.com/group/django-users?hl=en.
>
>

--
You received this message because you are subscribed to the Google Groups
"Django users" group.
To post to this group, send email to django-us...@googlegroups.com.
To unsubscribe from this group, send email to
django-users+unsubscr...@googlegroups.com.
For more options, visit this group athttp://groups.google.com/group/django-users?hl=en.

Offline

Board footer

Moderator control

Enjoy the 16th of December
PoweredBy

The Forums are managed by develissimo stuff members, if you find any issues or misplaced content please help us to fix it. Thank you! Tell us via Contact Options
Leave a Message
Welcome to Develissimo Live Support