- Posts: 111
- Thank you received: 20
Welcome to the LimeSurvey Community Forum
Ask the community, share ideas, and connect with other LimeSurvey users!
Data export not working for a lot of data columns (980+)
- orvil
- Topic Author
- Offline
- Premium Member
Less
More
4 years 6 months ago #189131
by orvil
Best regards/Beste Grüße,
O. Villani
Data export not working for a lot of data columns (980+) was created by orvil
Hi all,
hope I can find some help or hints on this problem:
I created a survey that has finally more than 980 data columns in the answer table. Unfortunately LS 3.18.0 (as well as some previous versions, but not versions 2.x) does not export more than 980 columns. All rows are truncated from column 981 upwards. I had a look at the corresponding DB answer table - all columns are there and properly filled.
Interestingly the data viewer of LS shows all columns!
I placed a bug report already, but meanwhile, does anyone have a) a workaround or b) some hints what is causing the problem, so that may be I can debug it myself?
Thanks in advance!
hope I can find some help or hints on this problem:
I created a survey that has finally more than 980 data columns in the answer table. Unfortunately LS 3.18.0 (as well as some previous versions, but not versions 2.x) does not export more than 980 columns. All rows are truncated from column 981 upwards. I had a look at the corresponding DB answer table - all columns are there and properly filled.
Interestingly the data viewer of LS shows all columns!
I placed a bug report already, but meanwhile, does anyone have a) a workaround or b) some hints what is causing the problem, so that may be I can debug it myself?
Thanks in advance!
Best regards/Beste Grüße,
O. Villani
The topic has been locked.
- holch
- Offline
- LimeSurvey Community Team
Less
More
- Posts: 11639
- Thank you received: 2737
4 years 6 months ago #189146
by holch
I answer at the LimeSurvey forum in my spare time, I'm not a LimeSurvey GmbH employee.
No support via private message.
Replied by holch on topic Data export not working for a lot of data columns (980+)
Only a workaround to get to the data for analysis:
During the export process you can define which data you want in the data file. Split it into two batches, first export the first 50% of questions, then the other 50% of columns. Of course you'll need to have the ID in both files to later join them.
During the export process you can define which data you want in the data file. Split it into two batches, first export the first 50% of questions, then the other 50% of columns. Of course you'll need to have the ID in both files to later join them.
I answer at the LimeSurvey forum in my spare time, I'm not a LimeSurvey GmbH employee.
No support via private message.
The following user(s) said Thank You: DenisChenu
The topic has been locked.
- orvil
- Topic Author
- Offline
- Premium Member
Less
More
- Posts: 111
- Thank you received: 20
4 years 6 months ago #189150
by orvil
Best regards/Beste Grüße,
O. Villani
Replied by orvil on topic Data export not working for a lot of data columns (980+)
Hello Holch,
thanks for your quick reply! This is a good workaround an a relieve for the next days. Anyhow, I hope the more easy way will work again
thanks for your quick reply! This is a good workaround an a relieve for the next days. Anyhow, I hope the more easy way will work again
Best regards/Beste Grüße,
O. Villani
The topic has been locked.
- holch
- Offline
- LimeSurvey Community Team
Less
More
- Posts: 11639
- Thank you received: 2737
4 years 6 months ago #189152
by holch
I answer at the LimeSurvey forum in my spare time, I'm not a LimeSurvey GmbH employee.
No support via private message.
Replied by holch on topic Data export not working for a lot of data columns (980+)
Definitely just a workaround and not a final solution. But sometimes the final solution can take a while. However, are you sure that LS exported more than this before? I think there was an even lower column limit for the export to excel a couple of years ago. Now I don't know about the CSV export.
Which format are you exporting to?
I couldn't find your bug report. Could you post a link here?
Which format are you exporting to?
I couldn't find your bug report. Could you post a link here?
I answer at the LimeSurvey forum in my spare time, I'm not a LimeSurvey GmbH employee.
No support via private message.
The topic has been locked.
- DenisChenu
- Offline
- LimeSurvey Community Team
Less
More
- Posts: 13597
- Thank you received: 2487
4 years 6 months ago #189160
by DenisChenu
Assistance on LimeSurvey forum and LimeSurvey core development are on my free time.
I'm not a LimeSurvey GmbH member, professional service on demand , plugin development .
I don't answer to private message.
Replied by DenisChenu on topic Data export not working for a lot of data columns (980+)
Thanks to @orvil : reported here :
bugs.limesurvey.org/view.php?id=15327
Assistance on LimeSurvey forum and LimeSurvey core development are on my free time.
I'm not a LimeSurvey GmbH member, professional service on demand , plugin development .
I don't answer to private message.
The following user(s) said Thank You: orvil
The topic has been locked.
- orvil
- Topic Author
- Offline
- Premium Member
Less
More
- Posts: 111
- Thank you received: 20
4 years 6 months ago #189179
by orvil
Best regards/Beste Grüße,
O. Villani
Replied by orvil on topic Data export not working for a lot of data columns (980+)
Hello Holch,
yes, absolutely sure, because I am doing that every week, for the last (almost) 4 years with roundabout 1500 columns. But it's version 2.05 that worked for me till yesterday when I replaced 2.05 by 3.18.0 ( well, a big step for me, a small for mankind )
yes, absolutely sure, because I am doing that every week, for the last (almost) 4 years with roundabout 1500 columns. But it's version 2.05 that worked for me till yesterday when I replaced 2.05 by 3.18.0 ( well, a big step for me, a small for mankind )
Best regards/Beste Grüße,
O. Villani
The topic has been locked.
- holch
- Offline
- LimeSurvey Community Team
Less
More
- Posts: 11639
- Thank you received: 2737
4 years 6 months ago #189202
by holch
I answer at the LimeSurvey forum in my spare time, I'm not a LimeSurvey GmbH employee.
No support via private message.
Replied by holch on topic Data export not working for a lot of data columns (980+)
OK, 2.05 is old. Very old, this behaviour could have been introduced many, many years ago... hahahahaha
I answer at the LimeSurvey forum in my spare time, I'm not a LimeSurvey GmbH employee.
No support via private message.
The topic has been locked.
- orvil
- Topic Author
- Offline
- Premium Member
Less
More
- Posts: 111
- Thank you received: 20
4 years 6 months ago #189295
by orvil
Best regards/Beste Grüße,
O. Villani
Replied by orvil on topic Data export not working for a lot of data columns (980+)
You are absolutely right
Anyhow DenisChenu found the reason and solution: it's the php.ini max_input_vars= setting that is usually limited to values like 1000
By increasing the limit eg to
max_input_vars = 2000
everything is working fine again!
Did that the last time in 2016 and forgot
Thanks to you all!
Anyhow DenisChenu found the reason and solution: it's the php.ini max_input_vars= setting that is usually limited to values like 1000
By increasing the limit eg to
max_input_vars = 2000
everything is working fine again!
Did that the last time in 2016 and forgot
Thanks to you all!
Best regards/Beste Grüße,
O. Villani
The following user(s) said Thank You: DenisChenu
The topic has been locked.
- DenisChenu
- Offline
- LimeSurvey Community Team
Less
More
- Posts: 13597
- Thank you received: 2487
4 years 6 months ago - 4 years 6 months ago #189296
by DenisChenu
Assistance on LimeSurvey forum and LimeSurvey core development are on my free time.
I'm not a LimeSurvey GmbH member, professional service on demand , plugin development .
I don't answer to private message.
Replied by DenisChenu on topic Data export not working for a lot of data columns (980+)
I report another issue
bugs.limesurvey.org/view.php?id=15339
Maybe about 15327: Data export stops after exactly 980 columns we must send a warning in export part ?
And a second one : 15340: Show a warning in export if max_input_vars OR allow «export ALL»
Maybe about 15327: Data export stops after exactly 980 columns we must send a warning in export part ?
And a second one : 15340: Show a warning in export if max_input_vars OR allow «export ALL»
Assistance on LimeSurvey forum and LimeSurvey core development are on my free time.
I'm not a LimeSurvey GmbH member, professional service on demand , plugin development .
I don't answer to private message.
Last edit: 4 years 6 months ago by DenisChenu.
The following user(s) said Thank You: orvil
The topic has been locked.
- orvil
- Topic Author
- Offline
- Premium Member
Less
More
- Posts: 111
- Thank you received: 20
4 years 6 months ago #189298
by orvil
Best regards/Beste Grüße,
O. Villani
Replied by orvil on topic Data export not working for a lot of data columns (980+)
@holch
One last thought: LimeSurvey 2.05 served my needs for a couple of years and some really tricky surveys. So I think that's a great prove for the quality of LS!
Cheers to all
One last thought: LimeSurvey 2.05 served my needs for a couple of years and some really tricky surveys. So I think that's a great prove for the quality of LS!
Cheers to all
Best regards/Beste Grüße,
O. Villani
The topic has been locked.
- holch
- Offline
- LimeSurvey Community Team
Less
More
- Posts: 11639
- Thank you received: 2737
4 years 6 months ago #189318
by holch
I answer at the LimeSurvey forum in my spare time, I'm not a LimeSurvey GmbH employee.
No support via private message.
Replied by holch on topic Data export not working for a lot of data columns (980+)
Oh, I am not saying that 2.05 is a bad piece of software. It was definitely one of the best releases Limesurvey had. However, when a software is that old doesn't receive any bug fixes or security updates, it can still serve the purpose, but you should still think about replacing it (which you finally did ).
In research we often work with private data and we need to make sure things are up to date. At least in my opinion. And 2.05 wasn't even the end of the branch, that was something like 2.06 LTS or Denis' fork that was (or still is?) providing bug fixes and security updates for this branch of Limesurvey.
In research we often work with private data and we need to make sure things are up to date. At least in my opinion. And 2.05 wasn't even the end of the branch, that was something like 2.06 LTS or Denis' fork that was (or still is?) providing bug fixes and security updates for this branch of Limesurvey.
I answer at the LimeSurvey forum in my spare time, I'm not a LimeSurvey GmbH employee.
No support via private message.
The following user(s) said Thank You: DenisChenu
The topic has been locked.