Raq3/4 to Directadmin migration

[Wunk]

We've currently still have 10ish Raq3 and Raq4's running a few hundred sites in total..

They're ticking timebombs.., there's an outdated 2.2 kernel that's impossible to upgrade without risking destroying the Raq, they lack patches, and the impossibility to make them raid is just waiting for another HD crash to happen..

Thus we're in need to migrate them over to a new and better system..

Does anyone know a way to migrate raq users and sites over to a Directadmin enviroment (And I don't mean by hand.. ;) ), I know there's Cpanel, Ensim and Plesk migration scripts, but that's just choosing the lesser of evils..

Being able to throw out our old raq's and have just 1 good Directadmin server running the accounts would make me sleep a lot better..

Any suggestions ?

[Icheb]

Strange/Stupid idea:

First migrate Raq to cPanel, than use cPanel to DA script.

Or modify the Raq to cPanel script to immedately convert to DA instead of cPanel.

Currenty I don't have the time to make such a script, but i do know a dutch company with the same problem.

[nobaloney]

We've migrated quite a few sites from RaQs to DA, for ourselves and for our clients. But we've done them all manually.

It's not that hard.

Jeff

[Wunk]

Got a few pointers ?


I was going to dive into the Raq database structure on how it's set up user and accountwise to see if I can dump and alter them to DA configfiles..

If you have some general hints on what I should pay attention to etc.., that would be great :)

[nobaloney]

We create the users (sites) then the email addresses, then move the data one domain at a time by tarring it on the RaQ and untarring it on the DA system.

The DA system will automatically create the DNS and it will work for probably 90-95% of the sites you move.

When you're done moving, test the sites by setting the new IP# in your local machine hosts file, and when you know it's working properly, move your DNS servers with your registrar by giving them the new IP#s where you register nameservers (not where you assign them).

Jeff

[Wunk]

And frontpage extensions ? (one of the items I'm always battling with)

[nobaloney]

Here's the way we did it...

We turned fpx off for all the sites on the RaQ.

We moved the sites.

Then we turned fpx on, on DA, for all the sites that needed it.

As I recall, we had one site with problems but reinstalling fixed it.

Jeff

[motobrandt]

I moved about 300 sites from 3 cobalt Raq4's. I've got some nice python scripts that use the API's in DA to create sites, virtual users etc. I've got instructions on moving the spool and shadow files too. These also run with Python scripts that my buddy wrote. I'll gather them up and organize them if you like.

As for FrontPage. Every Frontpage site had to be moved back to the Cobalt because we couldn't get it working and the support from DA was sort of like well...

Originally posted by DirectAdmin Support
At this point, you can try anything. I'm getting a bit P.O. about not being able to figure out what's going on. I'll probably eventually find it.. but it's taking longer than I'd like.

I think the problem is in the binary, but knowing Frontpage, it might be elsewhere, including the httpd.conf file.

John

So I haven't had the time to work on that any more. Maybe next week I'll search the forums again and see if I can figure it out. I'm running FreeBSD 4.8 by the way.

-brandt milczewski

[nobaloney]

Brandt,

I'd like to see your scripts if you don't mind sending them to me.

I don't know if they'll work for me or not, since I use RHL and not FreeBSD, but I'd like to try them and make any tweaks necessary. Of course I'll give back the tweaks to the DA community (with your permission).

On RaQ->RHL7.3/DA migrations we had a few minor problems with FPX, but we did get everything running (and I've got two unplugged RaQs on the table behind me as I write these words).

I'll be happy to help you try to setup FPX for sites on your DA systems in exchange for the scripts if you'd like, but please note my time constraints in my sig.

Thanks.

Jeff

[motobrandt]

OK Sure,

I'll round them up and get a little README together. Some scripts are for the Raq4 and some for the DA box.

Will you be checking in here at the forum or should I just email you when I get it together?

I've also got a question about reading the headers on spam that's getting through the new exim.conf file that you wrote. Which I'm using and I love by the way. I guess I'll post it over at the other thread about spamblocker though. Does the blacklist file that is created locally need server names to blacklist like charlie.brown.com ? or can it just blacklist domains like brown.com ?

cheers,
brandt milczewski

By the way I'm quite sure that they will work for any DA box. Only change might possibly be some pathing issues. but that's easy enough.

[nobaloney]

Thanks, Brandt.

Please email me a notice and I'll let you know when I'm back so we can get together then.

(When I'm back my sig will change back to the old one, even on already posted messages.)

I really can't help you with the SpamBlocker now; I won't have time to look at it until I return :( .

Which will be about June 3rd.

Jeff

[jjma]

Originally posted by motobrandt
OK Sure,

I'll round them up and get a little README together. Some scripts are for the Raq4 and some for the DA box.



Brandt,

I am doing exactly the same for a ra4 and a raq3 - could I have a copy of your script?

Thanks

Jon

[nobaloney]

Brandt,

I'm back now and I'll be happy to help you with any SpamBlocker issues.

Also to share your RaQ migration code.

Thanks!

Jeff

[jjma]

Just to add a me to......

A quick question to Jeff:

How did you go about migrating the web sites as the cobalt paths are completely different to DA's and would break any script once installed.

Jon

[jjma]

Hello

How did you get around the path issues with scripts? Did you have to manually change them - I supsect you did.

regards

Jon

[motobrandt]

Originally posted by jlasman
Brandt,

I'm back now and I'll be happy to help you with any SpamBlocker issues.

Also to share your RaQ migration code.

Thanks!

Jeff
OK I'll do this tonight while watching the Lakers/Pistons game.
My questions with the SpamBlocker are just about adding stuff to the blacklist file that I created. First off, the SpamBlocker is working great and saves tons of processor time by rejecting most Spam so it doesn't have to go through SpamAssassin and ClamAV. But I'm still getting quite a bit of spam through so I've been adding IP addresses and domain names to the blacklist.
Is that what I'm supposed to do? Do IP addresses work in the blacklist or does it have to be a server name?
Also can I block a domain throught the blacklist?
Can I block a range of IP's? say 80.192.80.* or [1-255]?
Thanks and I'll post what I've got for the migration stuff tonight.

cheers,
brandt

[nobaloney]

Those are great questions about the blacklist.

Unfortunately I don't know :( .

I'm using Exim code. I'll ask the Exim gurus and get back to you on it.

Jeff

[jjma]

Any update on the raq migration code? Urgently needed.....

Thanks

jon

[motobrandt]

Originally posted by jjma
Any update on the raq migration code? Urgently needed.....

Thanks

jon
I have compiled the list of files. I need to make some settings generic instead of specific for my servers. And then I'll post them here. Sorry about the delay ...:rolleyes: I'll get them done this afternoon. After I get my popSSL working. :)

[jjma]

Hi

Looking forward to it.

Cheers

Jon

[hci]

Any update on the raq migration code? Urgently needed.....


I have compiled the list of files. I need to make some settings generic instead of specific for my servers. And then I'll post them here. Sorry about the delay ... I'll get them done this afternoon. After I get my popSSL working.

Will this work on the RAQ550? If so, yipee!

Matthew

[nobaloney]

I don't see how it could, Matthew; the RaQ550 is a completely different animal, with completely different storage paths.

Jeff

[hci]

Is everyone familiar with RaqBackup?

http://www.neuhaus-internet.de/cobalt/raqbackup/

It only moves stuff between different flavors of RAQ's but perhaps it would help.

Matt

[nobaloney]

Yep; we've got it running on lots of systems.

If you read it carefully it will tell you what you have to save.

One big issue in moving sites between RaQs and DA is that DA uses a specific format for mySQL files; you can't just set up the same database names you used on your RaQs.

Jeff

[mikem]

I have a Raq2 that I need to migrate, can I just move the encrypted password from the Raq to Da?

Thanks Mike

[nobaloney]

I never tried it; try it and let us know if it works.

Jeff

[wilec]

is there any progress on this?

[nobaloney]

It's currently next on my major projects list, after I finish adding AV to my SpamBlocker exim.conf file.

(I've got a few requests for it from paying clients).

So then the question will be only will I give it away, offer it as a service, or offer it as a free script under Open Source?

I'm not sure yet, as I don't know how complex it will be to implement.

Have you, or has anyone, made any progress at all I can start with? If I start with someone else's work I'll have to make it available under Open Source :) .

Jeff