Wednesday 19 April 2017

Can i increase the maximum size for a JSONB record in postgres?

In Postgres 9.5.4 i'm getting the following error when trying to write a 500MB JSON file.

{ error: total size of jsonb array elements exceeds the maximum of 268435455 bytes
    at Connection.parseE (/Users/ted/code/fishco/api/node_modules/pg/lib/connection.js:554:11)
    at Connection.parseMessage (/Users/ted/code/fishco/api/node_modules/pg/lib/connection.js:381:17)
    at Socket.<anonymous> (/Users/ted/code/fishco/api/node_modules/pg/lib/connection.js:117:22)
    at emitOne (events.js:96:13)
    at Socket.emit (events.js:188:7)
    at readableAddChunk (_stream_readable.js:176:18)
    at Socket.Readable.push (_stream_readable.js:134:10)
    at TCP.onread (net.js:548:20)
  name: 'error',
  length: 140,
  severity: 'ERROR',
  code: '54000',
  detail: undefined,
  hint: undefined,
  position: undefined,
  internalPosition: undefined,
  internalQuery: undefined,
  where: undefined,
  schema: undefined,
  table: undefined,
  column: undefined,
  dataType: undefined,
  constraint: undefined,
  file: 'jsonb_util.c',
  line: '1526',
  routine: 'convertJsonbArray' }
total size of jsonb array elements exceeds the maximum of 268435455 bytes

PSQL Output:

fishco=# \d+ d_t_o_attributes
                                                               Table "public.d_t_o_attributes"
        Column         |            Type             |                           Modifiers                           | Storage  | Stats target | Description
-----------------------+-----------------------------+---------------------------------------------------------------+----------+--------------+-------------
 id                    | integer                     | not null default nextval('d_t_o_attributes_id_seq'::regclass) | plain    |              |
 createdAt             | timestamp without time zone | not null                                                      | plain    |              |
 docTopicDistributions | jsonb                       | not null                                                      | extended |              |

Question: Is there a way to increase the amount of data i can store? If not what other options should i look at?



via Jack Murphy

No comments:

Post a Comment