mysql - memory allocation problems with CakePHP -


i still have problem mempry usage of cake. read alot of threats , tried out 1000 things nothing help. use cakephp 2.4.x. working mysqldb. wrote api select log-data database. test explain confusing me much. i've select returns 1400 rows 11 columns. general memory usage (using memory_get_usage) 4mb. after select that: 

$condition = array('conditions'=> array(       'logbackend.created_at between ? , ?' => array(                                             $this->params['url']['from'],$this->params['url']['to']                                        )));      $this->data = $this->logbackend->find('all', $condition).

my memory usage explode more 9mb. there still no return or work data @ all. select. 9mb not if select more, should possible round 100k rows. 256mb run out of space. can tell me reason ridiculous memory usage?

best regards

just use paginate instead, , process data in chunks. cake geared towards chunks of 20 or rows going view. want produce report based on millions of rows. cakephp has function called paginate, can tricked doing mysql limit 100000,1000 pretty efficiently. found these hacks googling pretty intensely, there different syntax cakephp 1.3, , if nobody posts information on cake 3, , changes, come , post day.

// cakephp 2.4.1 $condition = array('conditions'=> array('logbackend.created_at between ? , ?' => array($this->params['url']['from'],$this->params['url']['to'])));  $this->paginate['conditions'] = $conditions['conditions']; $this->paginate['limit'] = 1000; // use ['fields'] = array('filed1', 'field2'); limit memory  /******* here trick paginate iter in ctrlr *****/ $this->request->params['named']['page']=1; $this->request->params['paging']['modelname']['nextpage'] = true; // chunks while ($this->request->params['paging']['modelname']['nextpage']) {     $rows = $this->paginate("modelname");     // boil down chunk of data      $this->request->params['named']['page']+=1; }

it doesn't make sense pass millions of rows view. while loop overwrite $rows each time, re-using core memory. challenge find clever way of distilling data, or writing new table during loop used in next pass of refinement. execution still slower on cakephp due model processing overhead, if there lot of unneeded columns, use paginate['fields'] process fields need. fields same thing columns.

php philosophically tied apache, isn't meant kind of thing. it's meant results in 30 seconds or less , render web page. isn't cake blame. python , ruby might better, perl. cry baby when have sift through tools format in html.


Comments

Post a Comment

Popular posts from this blog

Why does Ruby on Rails generate add a blank line to the end of a file? -

running rails generate controller foo home results in: class foocontroller < application controller def home end end (there's nothing on line in actual file, blank line) is there purpose blank line? it's common use newline indicate end of line, last line. many editors (like vi, use) add in newline silently. consensus text files (especially in unix world) should end in newline, , there have been problems historically if wasn't present. why should text files end newline? the tool used count lines in file "wc" counts newlines in file, without trailing newline show 3 instead of 4. it improves readability of templates used in generator. consider: https://github.com/rails/rails/blob/master/railties/lib/rails/generators/rails/controller/templates/controller.rb to remove trailing newline, template have last line of: end<% end -%> instead of: end <% end -%> that seems less readable me. the discussion below refers
Read more

keyboard - Smiles and long press feature in Android -

i've created android keyboard. how add features inserting smilies, , using long keypresses display symbols? to create long-press behavior allows select several options pop-up menu, follow guide (specifically pop-up menu section): http://developer.android.com/guide/topics/ui/menus.html smileys (also known emoticons) combination of keys, understood programs , parsed same way. have do, when clicks smiley face on keyboard, simulate pressing of key combination matching emoticon. example, when clicks smiley, should simulate key presses ':' , ')' :). here's list of emoticons: http://en.wikipedia.org/wiki/list_of_emoticons
Read more

node.js - Bad Request - node js ajax post -

i'm using express 3.0 , node v0.11.0. have button submits form , i'm using ajax post data json object node server. client code is: $('#contact').submit(function(e) { console.log('submit called'); var formdata = json.stringify($('form').serializeobject()); console.log(formdata); $.ajax({ url: "http://localhost:3000/savedata/", type: "post", datatype: 'json', data: {objectdata: formdata}, contenttype: "application/json", complete: function() { console.log('process complete'); }, success: function(data) { console.log('process sucess'); }, error: function() { console.log('process error'); }, }); return false; }); then on server: var express = require('express'); var app = express(); app.set('views', __dirname + '/views'); app.set('view engine', 'jade'); app.use(express.bodyparser());
Read more