aC forum: [Still a few things to iron out] Importing big projects from 0.7.1

Post #11 by davidm

davidm — Fri, 23 Nov 2007 10:39:14 UTC

OK I found it, it's in acx_project_users, I had to change the project_id to 7 :)

Post #10 by davidm

davidm — Fri, 23 Nov 2007 10:13:41 UTC

Okay there are still a few things which cause problems :

* Milestones and Checklists were not imported for my bigger project. I have tried to import just the milestones, tasks and tasklist tables via the importer (I exported those tables, and then re-imported them on a separate DB. It worked but I got stopped by errors "Faild to import..." for several records. I am stuck here...)

* For this project, I am unable to pick assignees for anything (task, milestone, whatever...). When I click "Change" no name appear. The project is linked to a client. There must be something amiss, probably due to the fact I created this project manually and assigned the project_id to the project objects... is there anything else I need to set manually to fix this ?

I have tried to spot what's missing looking at the other projects, but I can't figure it out...

Hmmm, I might be on to something : this is the only project for which the "People" project tab doesn't point to the right url :

Instead of http://espace-client.nodeo.net/public/index.php/projects/7/people - I get : http://espace-client.nodeo.net/public/index.php/projects/7/7

Post #9 by Ilija Studen

Ilija Studen — Thu, 22 Nov 2007 12:08:54 UTC

I'm really glad to hear that :) We are here if you need anything else.

Post #8 by davidm

davidm — Thu, 22 Nov 2007 11:55:34 UTC

Thanks a ton Ilija, it works !!!

I thought I'd never make it but I officially have switched from 0.7.1 to 1.0 :)

Post #7 by Ilija Studen

Ilija Studen — Thu, 22 Nov 2007 11:46:14 UTC

Just run this query (I assume that acx_ is your table prefix):

UPDATE acx_project_objects SET project_id = '7' WHERE project_id IN ('8', '9', '10', 11);

Post #6 by davidm

davidm — Thu, 22 Nov 2007 11:32:51 UTC

Ok this time I think I am close to making it ! I have transformed with a simple search and replace with TextMate all accented characters by non accented ones and now I have much less errors.

I have set my server to 512 Mb memory limit and 120 seconds max exec time.
I have been able to successfully import all project but the biggest one !

Good news is, I know where the problem is.
All project objects have been inserted, but the issue is, they have been assigned different project_id.

Maybe the project is too big, and thus it gets "splitted" into several ids. In my case project_id 7 to 11. The project itself is not created at the end of the process. I created it manually and gave it an id of 7.

Now, I need to change the project id for several hundreds of records who are set to project_id 8, 9, 10 and 11.
Problem is, I suck at MySQL :-\

Would anyone help me there change project_id value for the records with a project_id of 8,9,10,11 into a project_id of 7 in the acx_project_objects table ?

Thanks !!!

Post #5 by davidm

davidm — Wed, 21 Nov 2007 11:11:06 UTC

Thank you Ilija

The error stated that a few records had to be fixed before importing could go on.

I noticed those were short anwers like "yes" or "ok". Deleted them. Didn't get any warning after that. The process went on for something like 35 seconds and the importer says the project is imported, but it's not.

I am dropping the attemps to import anyway. It didn't work locally, so it's not an issue with resources. Accented characters being dropped, issues with imported tasks and whatnot, I'd rather start clean even if it means putting 3 days into transferring data manually...

I'll import users and company (this works fine) and work from there.

Post #4 by Ilija Studen

Ilija Studen — Wed, 21 Nov 2007 11:03:06 UTC

What error message do you get? Just that it failed to import data or something specific.

Regarding short comments: activeCollab 1.0 requires for a comment to have at least 5 characters. You can hack around this by changing Comment class located in /activecollab/application/modules/resources/models/comments/Comment.class.php:

function validate(&$errors) {
  if(strlen(trim(strip_tags($this->getBody()))) < 5) {
    $errors->addError(lang('Minimal content value is 5 characters'), 'body');
  } // if
  
  parent::validate($errors, true);
} // validate

to:

function validate(&$errors) {
  if(strlen(trim(strip_tags($this->getBody()))) < 1) {
    $errors->addError(lang('Minimal content value is 5 characters'), 'body');
  } // if
  
  parent::validate($errors, true);
} // validate

(drops limit to 1 character).

Post #3 by davidm

davidm — Wed, 21 Nov 2007 10:45:51 UTC

Again on importing.
I have set up an install locally on my 4Gb 2.4GHz iMac, and set the memory limit to 2Gb and max execution time @ 3600 seconds.

I had an error message for 4 comments (which I can't figure out, except they were very short comments, just "ok" or "yes"), which I deleted from the DB but the import did not come through anyway. My 2 biggest projects - for my biggest clients - can't be imported :-(

Which means I'll have to drop several months of project history and manually transfer content for open milestones, tasks... it's going to be time consuming :-\

If anyone has a method to import projects with hundreds of messages, files... I am still interrested !

Post #2 by davidm

davidm — Wed, 21 Nov 2007 09:32:28 UTC

A few things I discovered while trying to fix importing issues :

* It would seem no matter which project is imported, it doesn't get a company_id in the acx_projects table (or rather, all imported projects have a " 0 " value).

* Also, in the acx_companies table, 4 out of 6 project imported gets a manager_id also with a value of " 0 "

Last but not least, those projects who got imported have issues like I am unable to delete a simple task... this is frustrating !