[Mailman-Users] importing large (1GB) mbox file, hitting a wall here..

[Mark Sapiro]

On 12/27/2017 08:08 PM, Andrew White, PhD wrote:

>    I then ran bin/arch --wipe dbt-l_pdbti.org. When I
>    checked the archives, only about 11,000 messages were imported. I saw in
>    the arch help file there can be memory issues, and so to run things in
>    chunks. So, I did this:
> 
>    bin/arch ---wipe q -s 0 e 10000 dbt-l_pdbti.org
>    bin/arch -q -s 10001 e 20000 dbt-l_pdbti.org
>    bin/arch  q -s 20001 e 30000 dbt-l_pdbti.org
>    bin/arch  q -s 30001 e 40000 dbt-l_pdbti.org
> 
>    So when I do this, each piece works, but each piece overwrites the
>    previous- in other words, rather than each chunk adding into the archives,
>    only the most recent command seems to affect the archives. At the end of
>    these commands, only messages 30,000 to 35,000 are showing up in the
>    archives.


Are you sure you are not including the --wipe option on the subsequent
commands? The behavior you describe should not occur unless --wipe is
specified on the subsequent commands.

-- 
Mark Sapiro <mark at msapiro.net>        The highway is for gamblers,
San Francisco Bay Area, California    better use your sense - B. Dylan