Skip to content

bug with array struct field when copying from duckdb to vortex #6125

@uwemaurer

Description

@uwemaurer

What happened?

I have this small (1kb) data file which causes a crash when I try to export it to vortex.

D load vortex;
D describe select * from 'test.json';
┌─────────────┬───────────────────────────────────────────────────────────────────┬─────────┬─────────┬─────────┬─────────┐
│ column_name │                            column_type                            │  null   │   key   │ default │  extra  │
│   varchar   │                              varchar                              │ varchar │ varchar │ varchar │ varchar │
├─────────────┼───────────────────────────────────────────────────────────────────┼─────────┼─────────┼─────────┼─────────┤
│ stats       │ STRUCT(v DOUBLE, country STRUCT("key" VARCHAR, "value" DOUBLE)[]) │ YES     │ NULL    │ NULL    │ NULL    │
└─────────────┴───────────────────────────────────────────────────────────────────┴─────────┴─────────┴─────────┴─────────┘
D copy ( select * from 'test.json') to 'test.vortex' (format vortex);
memory allocation of 2012518595690544 bytes failed
Aborted (core dumped)

test.json

Steps to reproduce

see above

Environment

  • vortex extension: dae36cd
  • duckdb 1.4.3

Additional context

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugA bug issue

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions