Welcome to the LimeSurvey Community Forum

Ask the community, share ideas, and connect with other LimeSurvey users!

LS on a server cluster. Was: What is the max response-id limesurvey can handle?

  • hvgard
  • hvgard's Avatar Topic Author
  • Offline
  • Junior Member
  • Junior Member
More
5 years 5 months ago #175972 by hvgard
Hi,

I 'm more sure this is the right category for this Q. So apologies when this one is on the wrong place.

What is the max response-id limesurvey can handle? I'm not much of a database guy. So looking up the datatype is beyond me. Let alone find the answer.

We are on Version 2.6.7-lts Build 171212

Thanks, Harold

Harold van Garderen
The topic has been locked.
  • holch
  • holch's Avatar
  • Offline
  • LimeSurvey Community Team
  • LimeSurvey Community Team
More
5 years 5 months ago #175995 by holch
What do you mean with max response-id? The maximum length of digits a response ID can have or the maximum number of response-Id.

And what do you refer to as "response-id" exactly?

I answer at the LimeSurvey forum in my spare time, I'm not a LimeSurvey GmbH employee.
No support via private message.

The topic has been locked.
  • hvgard
  • hvgard's Avatar Topic Author
  • Offline
  • Junior Member
  • Junior Member
More
5 years 5 months ago #175997 by hvgard
Hi, thanks for you response.

We will soon have a project where a Limesurvey survey can get over 10 million "visits". I want to make sure we don't run out of the allowed ID range.

So I mean the maximum (largest) number the ID field can get. A million, 10 milllion? 2^16, 2^32? PS: I guess ID is has unsigned type in the MySQL database.

Thanks, Harold

Harold van Garderen
The topic has been locked.
  • DenisChenu
  • DenisChenu's Avatar
  • Offline
  • LimeSurvey Community Team
  • LimeSurvey Community Team
More
5 years 5 months ago #175999 by DenisChenu
int : (AUTO_INCREMENT) : 2^(31) more than 2 billion …

Assistance on LimeSurvey forum and LimeSurvey core development are on my free time.
I'm not a LimeSurvey GmbH member, professional service on demand , plugin development .
I don't answer to private message.
The topic has been locked.
  • holch
  • holch's Avatar
  • Offline
  • LimeSurvey Community Team
  • LimeSurvey Community Team
More
5 years 4 months ago #176003 by holch

We will soon have a project where a Limesurvey survey can get over 10 million "visits".


Wow, that is some serious stuff. Because in my experience, you get a return of max. 10% (maybe if you have a very special relationship with your audience you can get more, but with these numbers I doubt that there is a very special relationship).

So this would mean you would invite about 100 Million people?

I guess you have other problems than just the number of lines in the MySQL database or the potential length of the id for each response.

I guess you have heaving machinery ready, with a lot of memory, CPU power and SSD disk space to handle a load like this. Report your experience here please!

I answer at the LimeSurvey forum in my spare time, I'm not a LimeSurvey GmbH employee.
No support via private message.

The topic has been locked.
More
5 years 4 months ago #176012 by jelo

holch wrote: Wow, that is some serious stuff. Because in my experience, you get a return of max. 10%

The project with 10 million "visits" could be very small in terms of server resources. Depends on the timeframe. The question about the ID could be the biggest issues.

@Harold: Can you share two lines about the project scope? Classic survey? Transaction feedback?

The meaning of the word "stable" for users
www.limesurvey.org/forum/development/117...ord-stable-for-users
The topic has been locked.
  • hvgard
  • hvgard's Avatar Topic Author
  • Offline
  • Junior Member
  • Junior Member
More
5 years 4 months ago #176017 by hvgard
Thanks Denis. That should suffice for a while :-).

Harold van Garderen
The topic has been locked.
  • hvgard
  • hvgard's Avatar Topic Author
  • Offline
  • Junior Member
  • Junior Member
More
5 years 4 months ago #176019 by hvgard
Hi Jelo, it is a "stories" project on education for parents, teachers and children/youth. We will gather responses for 6 months. But in january there will be a campaign via regular media and we expect up to 40k visitors per hour.

Harold van Garderen
The topic has been locked.
  • hvgard
  • hvgard's Avatar Topic Author
  • Offline
  • Junior Member
  • Junior Member
More
5 years 4 months ago #176020 by hvgard
The potential audience is indeed 5.5 million. Even when 10% responds this means a half million responses. And people are invited to come back to share experiences.

We indeed have "thick" database servers and so far 5 webservers in a cluster to handle peak loads. We can expand the # of webservers (hardware or CPU's of memory) in 10 tot 15 mins. We can currently scale up to 12 if I remember well.

Harold van Garderen
The topic has been locked.
More
5 years 4 months ago #176021 by jelo
Thanks for the insight.

hvgard wrote: we expect up to 40k visitors per hour.

Here comes the flood. Good
luck with the project. Some kind of horizontal or vertical scaling seems to be needed, to handle that amount of visitors.

The meaning of the word "stable" for users
www.limesurvey.org/forum/development/117...ord-stable-for-users
The topic has been locked.
  • hvgard
  • hvgard's Avatar Topic Author
  • Offline
  • Junior Member
  • Junior Member
More
5 years 4 months ago #176023 by hvgard
:-). For that we have hired professional server managers and there will be an appropriate service level agreement. From the top of my head: 16 hours/day with 2 hour response time.

Harold van Garderen
The topic has been locked.
  • holch
  • holch's Avatar
  • Offline
  • LimeSurvey Community Team
  • LimeSurvey Community Team
More
5 years 4 months ago #176060 by holch

The potential audience is indeed 5.5 million.


So the whole population of Finland...

Sounds interesting. However, a campaign via regular media probably means a response rate far below my pretty high estimate of 10%. I'd rather go towards 1%. I assume that potential audience means you can theoretically reach 5.5 Million. However, if regular media means TV, newspapers, etc, then the actual audience is probably a lot lower (not everyone will watch TV or read the newspapers), and people, if not targeted directly are less likely to respond than when invited directly. Anyway, as I don't know anything about your actual target group I might be totally wrong.

Sounds like you have put some thoughts into this with professional server managers and I guess you and them have made some stress tests already.

Good luck! And please report back once the project is running or has finished.

I answer at the LimeSurvey forum in my spare time, I'm not a LimeSurvey GmbH employee.
No support via private message.

The topic has been locked.

Lime-years ahead

Online-surveys for every purse and purpose