[Still a few things to iron out] Importing big projects from 0.7.1
Page: 1, 2
Recent posts in this topic
Now that I have the importer up and running, I have been able to import 4 out of 6 projects (being french, I had to suffer a problem during import though : accented characters are dropped out during import :-\ )
The first 4 are comparatively small project while the other 2 are quite big (lots of messages, files... etc).
I have read that you have to increase memory limit way beyond the 8MB default in php.ini and the max execution time way beyond 30 seconds.
Which I did : I upped thing to 512Mb (half my server's memory !) and 360 seconds !!!
But the bigger projects don't import.
The process starts and gets killed after a little over 5 seconds...
Did anyone experience the same issue ?
And how did you solve it (any setting to recommend ?) ?
Thanks !
The first 4 are comparatively small project while the other 2 are quite big (lots of messages, files... etc).
I have read that you have to increase memory limit way beyond the 8MB default in php.ini and the max execution time way beyond 30 seconds.
Which I did : I upped thing to 512Mb (half my server's memory !) and 360 seconds !!!
But the bigger projects don't import.
The process starts and gets killed after a little over 5 seconds...
Did anyone experience the same issue ?
And how did you solve it (any setting to recommend ?) ?
Thanks !
The best way to predict the future is to invent it
------------------------------------------
Apache 2.2.8 - MySQL 5.0.45 - PHP 5.2.6 | Debian 4.0 (Etch)
------------------------------------------
Apache 2.2.8 - MySQL 5.0.45 - PHP 5.2.6 | Debian 4.0 (Etch)
A few things I discovered while trying to fix importing issues :
* It would seem no matter which project is imported, it doesn't get a company_id in the acx_projects table (or rather, all imported projects have a " 0 " value).
* Also, in the acx_companies table, 4 out of 6 project imported gets a manager_id also with a value of " 0 "
Last but not least, those projects who got imported have issues like I am unable to delete a simple task... this is frustrating !
* It would seem no matter which project is imported, it doesn't get a company_id in the acx_projects table (or rather, all imported projects have a " 0 " value).
* Also, in the acx_companies table, 4 out of 6 project imported gets a manager_id also with a value of " 0 "
Last but not least, those projects who got imported have issues like I am unable to delete a simple task... this is frustrating !
The best way to predict the future is to invent it
------------------------------------------
Apache 2.2.8 - MySQL 5.0.45 - PHP 5.2.6 | Debian 4.0 (Etch)
------------------------------------------
Apache 2.2.8 - MySQL 5.0.45 - PHP 5.2.6 | Debian 4.0 (Etch)
Again on importing.
I have set up an install locally on my 4Gb 2.4GHz iMac, and set the memory limit to 2Gb and max execution time @ 3600 seconds.
I had an error message for 4 comments (which I can't figure out, except they were very short comments, just "ok" or "yes"), which I deleted from the DB but the import did not come through anyway. My 2 biggest projects - for my biggest clients - can't be imported :-(
Which means I'll have to drop several months of project history and manually transfer content for open milestones, tasks... it's going to be time consuming :-\
If anyone has a method to import projects with hundreds of messages, files... I am still interrested !
I have set up an install locally on my 4Gb 2.4GHz iMac, and set the memory limit to 2Gb and max execution time @ 3600 seconds.
I had an error message for 4 comments (which I can't figure out, except they were very short comments, just "ok" or "yes"), which I deleted from the DB but the import did not come through anyway. My 2 biggest projects - for my biggest clients - can't be imported :-(
Which means I'll have to drop several months of project history and manually transfer content for open milestones, tasks... it's going to be time consuming :-\
If anyone has a method to import projects with hundreds of messages, files... I am still interrested !
The best way to predict the future is to invent it
------------------------------------------
Apache 2.2.8 - MySQL 5.0.45 - PHP 5.2.6 | Debian 4.0 (Etch)
------------------------------------------
Apache 2.2.8 - MySQL 5.0.45 - PHP 5.2.6 | Debian 4.0 (Etch)
Ilija Studen
on Nov 21. 2007. 11:03 am
What error message do you get? Just that it failed to import data or something specific.
Regarding short comments: activeCollab 1.0 requires for a comment to have at least 5 characters. You can hack around this by changing Comment class located in /activecollab/application/modules/resources/models/comments/Comment.class.php:
to:
(drops limit to 1 character).
Regarding short comments: activeCollab 1.0 requires for a comment to have at least 5 characters. You can hack around this by changing Comment class located in /activecollab/application/modules/resources/models/comments/Comment.class.php:
function validate(&$errors) {
if(strlen(trim(strip_tags($this->getBody()))) < 5) {
$errors->addError(lang('Minimal content value is 5 characters'), 'body');
} // if
parent::validate($errors, true);
} // validateto:
function validate(&$errors) {
if(strlen(trim(strip_tags($this->getBody()))) < 1) {
$errors->addError(lang('Minimal content value is 5 characters'), 'body');
} // if
parent::validate($errors, true);
} // validate(drops limit to 1 character).
activeCollab team member | LinkedIn
Thank you Ilija
The error stated that a few records had to be fixed before importing could go on.
I noticed those were short anwers like "yes" or "ok". Deleted them. Didn't get any warning after that. The process went on for something like 35 seconds and the importer says the project is imported, but it's not.
I am dropping the attemps to import anyway. It didn't work locally, so it's not an issue with resources. Accented characters being dropped, issues with imported tasks and whatnot, I'd rather start clean even if it means putting 3 days into transferring data manually...
I'll import users and company (this works fine) and work from there.
The error stated that a few records had to be fixed before importing could go on.
I noticed those were short anwers like "yes" or "ok". Deleted them. Didn't get any warning after that. The process went on for something like 35 seconds and the importer says the project is imported, but it's not.
I am dropping the attemps to import anyway. It didn't work locally, so it's not an issue with resources. Accented characters being dropped, issues with imported tasks and whatnot, I'd rather start clean even if it means putting 3 days into transferring data manually...
I'll import users and company (this works fine) and work from there.
The best way to predict the future is to invent it
------------------------------------------
Apache 2.2.8 - MySQL 5.0.45 - PHP 5.2.6 | Debian 4.0 (Etch)
------------------------------------------
Apache 2.2.8 - MySQL 5.0.45 - PHP 5.2.6 | Debian 4.0 (Etch)
Ok this time I think I am close to making it ! I have transformed with a simple search and replace with TextMate all accented characters by non accented ones and now I have much less errors.
I have set my server to 512 Mb memory limit and 120 seconds max exec time.
I have been able to successfully import all project but the biggest one !
Good news is, I know where the problem is.
All project objects have been inserted, but the issue is, they have been assigned different project_id.
Maybe the project is too big, and thus it gets "splitted" into several ids. In my case project_id 7 to 11. The project itself is not created at the end of the process. I created it manually and gave it an id of 7.
Now, I need to change the project id for several hundreds of records who are set to project_id 8, 9, 10 and 11.
Problem is, I suck at MySQL :-\
Would anyone help me there change project_id value for the records with a project_id of 8,9,10,11 into a project_id of 7 in the acx_project_objects table ?
Thanks !!!
I have set my server to 512 Mb memory limit and 120 seconds max exec time.
I have been able to successfully import all project but the biggest one !
Good news is, I know where the problem is.
All project objects have been inserted, but the issue is, they have been assigned different project_id.
Maybe the project is too big, and thus it gets "splitted" into several ids. In my case project_id 7 to 11. The project itself is not created at the end of the process. I created it manually and gave it an id of 7.
Now, I need to change the project id for several hundreds of records who are set to project_id 8, 9, 10 and 11.
Problem is, I suck at MySQL :-\
Would anyone help me there change project_id value for the records with a project_id of 8,9,10,11 into a project_id of 7 in the acx_project_objects table ?
Thanks !!!
The best way to predict the future is to invent it
------------------------------------------
Apache 2.2.8 - MySQL 5.0.45 - PHP 5.2.6 | Debian 4.0 (Etch)
------------------------------------------
Apache 2.2.8 - MySQL 5.0.45 - PHP 5.2.6 | Debian 4.0 (Etch)
Ilija Studen
on Nov 22. 2007. 11:46 am
Just run this query (I assume that acx_ is your table prefix):
UPDATE acx_project_objects SET project_id = '7' WHERE project_id IN ('8', '9', '10', 11);
activeCollab team member | LinkedIn
Thanks a ton Ilija, it works !!!
I thought I'd never make it but I officially have switched from 0.7.1 to 1.0 :)
I thought I'd never make it but I officially have switched from 0.7.1 to 1.0 :)
The best way to predict the future is to invent it
------------------------------------------
Apache 2.2.8 - MySQL 5.0.45 - PHP 5.2.6 | Debian 4.0 (Etch)
------------------------------------------
Apache 2.2.8 - MySQL 5.0.45 - PHP 5.2.6 | Debian 4.0 (Etch)
Ilija Studen
on Nov 22. 2007. 12:08 pm
I'm really glad to hear that :) We are here if you need anything else.
activeCollab team member | LinkedIn
Okay there are still a few things which cause problems :
* Milestones and Checklists were not imported for my bigger project. I have tried to import just the milestones, tasks and tasklist tables via the importer (I exported those tables, and then re-imported them on a separate DB. It worked but I got stopped by errors "Faild to import..." for several records. I am stuck here...)
* For this project, I am unable to pick assignees for anything (task, milestone, whatever...). When I click "Change" no name appear. The project is linked to a client. There must be something amiss, probably due to the fact I created this project manually and assigned the project_id to the project objects... is there anything else I need to set manually to fix this ?
I have tried to spot what's missing looking at the other projects, but I can't figure it out...
Hmmm, I might be on to something : this is the only project for which the "People" project tab doesn't point to the right url :
Instead of http://espace-client.nodeo.net/public/index.php/projects/7/people - I get : http://espace-client.nodeo.net/public/index.php/projects/7/7
* Milestones and Checklists were not imported for my bigger project. I have tried to import just the milestones, tasks and tasklist tables via the importer (I exported those tables, and then re-imported them on a separate DB. It worked but I got stopped by errors "Faild to import..." for several records. I am stuck here...)
* For this project, I am unable to pick assignees for anything (task, milestone, whatever...). When I click "Change" no name appear. The project is linked to a client. There must be something amiss, probably due to the fact I created this project manually and assigned the project_id to the project objects... is there anything else I need to set manually to fix this ?
I have tried to spot what's missing looking at the other projects, but I can't figure it out...
Hmmm, I might be on to something : this is the only project for which the "People" project tab doesn't point to the right url :
Instead of http://espace-client.nodeo.net/public/index.php/projects/7/people - I get : http://espace-client.nodeo.net/public/index.php/projects/7/7
The best way to predict the future is to invent it
------------------------------------------
Apache 2.2.8 - MySQL 5.0.45 - PHP 5.2.6 | Debian 4.0 (Etch)
------------------------------------------
Apache 2.2.8 - MySQL 5.0.45 - PHP 5.2.6 | Debian 4.0 (Etch)
