- Posts: 4
- Thank you received: 0
Welcome to the LimeSurvey Community Forum
Ask the community, share ideas, and connect with other LimeSurvey users!
Is it possible to export survey data in the background?
- alucard001
- Topic Author
- Offline
- New Member
Less
More
2 months 5 days ago #256884
by alucard001
Is it possible to export survey data in the background? was created by alucard001
Please help us help you and fill where relevant:
Your LimeSurvey version: 6.4.2+240115
Own server or LimeSurvey hosting: Own Server (AWS Linux)
Survey theme/template: default
==================
I have some survey result with over 30 fields and 2000+ response. My manager would like to export it in Excel format.
Yet the time exporting that file is beyond 1 min, which is the maximum timeout period from AWS cloudfront.
Other than increasing the timeout of PHP, may I ask if Limesurvey can export result on the background, so that it can bypass the timeout issue?
Thank you in advance for your help.
Your LimeSurvey version: 6.4.2+240115
Own server or LimeSurvey hosting: Own Server (AWS Linux)
Survey theme/template: default
==================
I have some survey result with over 30 fields and 2000+ response. My manager would like to export it in Excel format.
Yet the time exporting that file is beyond 1 min, which is the maximum timeout period from AWS cloudfront.
Other than increasing the timeout of PHP, may I ask if Limesurvey can export result on the background, so that it can bypass the timeout issue?
Thank you in advance for your help.
Please Log in to join the conversation.
- DenisChenu
- Offline
- LimeSurvey Community Team
Less
More
- Posts: 13648
- Thank you received: 2491
2 months 5 days ago #256900
by DenisChenu
Assistance on LimeSurvey forum and LimeSurvey core development are on my free time.
I'm not a LimeSurvey GmbH member, professional service on demand , plugin development .
I don't answer to private message.
Replied by DenisChenu on topic Is it possible to export survey data in the background?
I think the only way is to create a plugin for this (but i don't know how to start).
Else : export 200 by 200 with api.limesurvey.org/classes/remotecontrol...hod_export_responses
Else : export 200 by 200 with api.limesurvey.org/classes/remotecontrol...hod_export_responses
Assistance on LimeSurvey forum and LimeSurvey core development are on my free time.
I'm not a LimeSurvey GmbH member, professional service on demand , plugin development .
I don't answer to private message.
The following user(s) said Thank You: tpartner
Please Log in to join the conversation.
- holch
- Offline
- LimeSurvey Community Team
Less
More
- Posts: 11660
- Thank you received: 2742
2 months 5 days ago #256936
by holch
I answer at the LimeSurvey forum in my spare time, I'm not a LimeSurvey GmbH employee.
No support via private message.
Replied by holch on topic Is it possible to export survey data in the background?
Check if exporting to CSV is maybe quicker. If so, convert the downloaded CSV to Excel later.
I answer at the LimeSurvey forum in my spare time, I'm not a LimeSurvey GmbH employee.
No support via private message.
The following user(s) said Thank You: tpartner
Please Log in to join the conversation.
- tpartner
- Offline
- LimeSurvey Community Team
Less
More
- Posts: 10109
- Thank you received: 3595
2 months 5 days ago #256943
by tpartner
Cheers,
Tony Partner
Solutions, code and workarounds presented in these forums are given without any warranty, implied or otherwise.
Replied by tpartner on topic Is it possible to export survey data in the background?
Yeah, and maybe export using codes only.Check if exporting to CSV is maybe quicker. If so, convert the downloaded CSV to Excel later.
Cheers,
Tony Partner
Solutions, code and workarounds presented in these forums are given without any warranty, implied or otherwise.
The following user(s) said Thank You: DenisChenu
Please Log in to join the conversation.
- alucard001
- Topic Author
- Offline
- New Member
Less
More
- Posts: 4
- Thank you received: 0
2 months 5 days ago #256951
by alucard001
Replied by alucard001 on topic Is it possible to export survey data in the background?
Thanks for your reference.
Please Log in to join the conversation.
- alucard001
- Topic Author
- Offline
- New Member
Less
More
- Posts: 4
- Thank you received: 0
2 months 5 days ago #256952
by alucard001
Replied by alucard001 on topic Is it possible to export survey data in the background?
Thank you, yet if the number of responses is over 20,000 or larger, it will still have timeout issue.
Please Log in to join the conversation.
- DenisChenu
- Offline
- LimeSurvey Community Team
Less
More
- Posts: 13648
- Thank you received: 2491
2 months 4 days ago #256985
by DenisChenu
Assistance on LimeSurvey forum and LimeSurvey core development are on my free time.
I'm not a LimeSurvey GmbH member, professional service on demand , plugin development .
I don't answer to private message.
Replied by DenisChenu on topic Is it possible to export survey data in the background?
Then seems you need to export 5000 by 5000Thank you, yet if the number of responses is over 20,000 or larger, it will still have timeout issue.
Assistance on LimeSurvey forum and LimeSurvey core development are on my free time.
I'm not a LimeSurvey GmbH member, professional service on demand , plugin development .
I don't answer to private message.
Please Log in to join the conversation.
- holch
- Offline
- LimeSurvey Community Team
Less
More
- Posts: 11660
- Thank you received: 2742
2 months 4 days ago #257018
by holch
The initial discussion was about 2000+ responses. While 20000 is of course within "2000+" I assumed that the responses might be between 2000-3000 max. Not 20000 or more.
It is not overly surprising that you might run into some issues when exporting 20000+ responses and the maximum execution time is 1 minute. If you can't adapt the max execution time, you need to speed up the process. Either by exporting in batches or trying to get a quicker processer that can run the script in less time. But there might be also other factors that impact (the way how you connect to the database, etc). And you might also run into max_vars limits with this amount of responses.
I answer at the LimeSurvey forum in my spare time, I'm not a LimeSurvey GmbH employee.
No support via private message.
Replied by holch on topic Is it possible to export survey data in the background?
Thank you, yet if the number of responses is over 20,000 or larger, it will still have timeout issue.
The initial discussion was about 2000+ responses. While 20000 is of course within "2000+" I assumed that the responses might be between 2000-3000 max. Not 20000 or more.
It is not overly surprising that you might run into some issues when exporting 20000+ responses and the maximum execution time is 1 minute. If you can't adapt the max execution time, you need to speed up the process. Either by exporting in batches or trying to get a quicker processer that can run the script in less time. But there might be also other factors that impact (the way how you connect to the database, etc). And you might also run into max_vars limits with this amount of responses.
I answer at the LimeSurvey forum in my spare time, I'm not a LimeSurvey GmbH employee.
No support via private message.
The following user(s) said Thank You: DenisChenu
Please Log in to join the conversation.