Discussion:
[Moses-support] terminate called after throwing an instance of 'util::FDException'
Arezoo Arjomand
2018-09-01 09:20:02 UTC
Permalink
Hi all,
I  run    the    following    command    to    tune    rule-table    but    the  error    is   appeared.   
thank    you  

error:
Using SCRIPTS_ROOTDIR: /home/arezoo1/mosesdecoder-master/mosesdecoder-master/scripts
Assuming --mertdir=/home/arezoo1/mosesdecoder-master/mosesdecoder-master/bin
Using cached features list: ./features.list
MERT starting values and ranges for random generation:
  WordPenalty0 =  -1.000 ( 0.00 ..  1.00)
  PhrasePenalty0 =   0.200 ( 0.00 ..  1.00)
  TranslationModel0 =   0.200 ( 0.00 ..  1.00)
  TranslationModel0 =   0.200 ( 0.00 ..  1.00)
  TranslationModel0 =   0.200 ( 0.00 ..  1.00)
  TranslationModel0 =   0.200 ( 0.00 ..  1.00)
  TranslationModel1 =   1.000 ( 0.00 ..  1.00)
    LM0 =   0.500 ( 0.00 ..  1.00)
featlist: WordPenalty0=-1
featlist: PhrasePenalty0=0.2
featlist: TranslationModel0=0.2
featlist: TranslationModel0=0.2
featlist: TranslationModel0=0.2
featlist: TranslationModel0=0.2
featlist: TranslationModel1=1
featlist: LM0=0.5
run 1 start at Sat Sep  1 04:57:35 EDT 2018
Parsing --decoder-flags: |-v 0|
Saving new config to: ./run1.moses.ini
Saved: ./run1.moses.ini
Normalizing lambdas: -1 0.2 0.2 0.2 0.2 0.2 1 0.5
DECODER_CFG = -weight-overwrite 'LM0= 0.142857 PhrasePenalty0= 0.057143 WordPenalty0= -0.285714 TranslationModel0= 0.057143 0.057143 0.057143 0.057143 TranslationModel1= 0.285714'
Executing: /home/arezoo1/mosesdecoder-master/mosesdecoder-master/bin/moses2 -v 0  -config /home/arezoo1/emlla/train/model/moses.ini -inputtype 3 -weight-overwrite 'LM0= 0.142857 PhrasePenalty0= 0.057143 WordPenalty0= -0.285714 TranslationModel0= 0.057143 0.057143 0.057143 0.057143 TranslationModel1= 0.285714'  -n-best-list run1.best100.out 100 distinct  -input-file /home/arezoo1/emlla/nc-dev2007.true.fr > run1.out
Executing: /home/arezoo1/mosesdecoder-master/mosesdecoder-master/bin/moses2 -v 0  -config /home/arezoo1/emlla/train/model/moses.ini -inputtype 3 -weight-overwrite 'LM0= 0.142857 PhrasePenalty0= 0.057143 WordPenalty0= -0.285714 TranslationModel0= 0.057143 0.057143 0.057143 0.057143 TranslationModel1= 0.285714'  -n-best-list run1.best100.out 100 distinct  -input-file /home/arezoo1/emlla/nc-dev2007.true.fr > run1.out
1-10.20.2 0.2 0.2 0.210.5(1) run decoder to produce n-best lists
params = -v 0
decoder_config = -weight-overwrite 'LM0= 0.142857 PhrasePenalty0= 0.057143 WordPenalty0= -0.285714 TranslationModel0= 0.057143 0.057143 0.057143 0.057143 TranslationModel1= 0.285714'
Starting...
START featureFunctions.Load()
Loading WordPenalty0
Finished loading WordPenalty0
Loading PhrasePenalty0
Finished loading PhrasePenalty0
Loading LM0
terminate called after throwing an instance of 'util::FDException'
  what():  util/file.cc:175 in std::size_t util::PartialRead(int, void*, std::size_t) threw FDException because `ret < 0'.
Is a directory in /home/arezoo1/emlla while reading 6 bytes in file /home/arezoo1/emlla
Aborted (core dumped)
Exit code: 134
The decoder died. CONFIG WAS -weight-overwrite 'LM0= 0.142857 PhrasePenalty0= 0.057143 WordPenalty0= -0.285714 TranslationModel0= 0.057143 0.057143 0.057143 0.057143 TranslationModel1= 0.285714'



train:

/home/arezoo1/mosesdecoder-master/mosesdecoder-master/scripts/training/train-model.perl \
-root-dir train \
-corpus /home/arezoo1/emlla/news-commentary-v8.fr-en.clean \
-f fr -e en -alignment grow-diag-final-and -hierarchical -glue-grammar \ -lm 0:3:/home/arezoo1/emlla/news-commentary-v8.fr-en.blm.en \
-mgiza -mgiza-cpus 4 \
-external-bin-dir /home/arezoo1/mosesdecoder-master/mosesdecoder-master/tools >&training2.out


tune:
/home/arezoo1/mosesdecoder-master/mosesdecoder-master/scripts/training/mert-moses.pl  /home/arezoo1/emlla/nc-dev2007.true.fr /home/arezoo1/emlla/nc-dev2007.true.en  /home/arezoo1/mosesdecoder-master/mosesdecoder-master/bin/moses2  /home/arezoo1/emlla/train/model/moses.ini  --rootdir /home/arezoo1/mosesdecoder-master/mosesdecoder-master/scripts --decoder-flags "-v 0"  --no-filter-phrase-table --inputtype 3  --batch-mira  --return-best-dev --filtercmd '/home/arezoo1/mosesdecoder-master/mosesdecoder-master/scripts/training/filter-model-given-input.pl'  --batch-mira-args '-J 300' 1>&mert.out
Hieu Hoang
2018-09-02 10:23:52 UTC
Permalink
can you please let me see the file
/home/arezoo1/emlla/train/model/moses.ini

Hieu Hoang
http://statmt.org/hieu
Post by Arezoo Arjomand
Hi all,
I run the following command to tune rule-table
but the error is appeared.
thank you
/home/arezoo1/mosesdecoder-master/mosesdecoder-master/scripts
Assuming
--mertdir=/home/arezoo1/mosesdecoder-master/mosesdecoder-master/bin
Using cached features list: ./features.list
WordPenalty0 = -1.000 ( 0.00 .. 1.00)
PhrasePenalty0 = 0.200 ( 0.00 .. 1.00)
TranslationModel0 = 0.200 ( 0.00 .. 1.00)
TranslationModel0 = 0.200 ( 0.00 .. 1.00)
TranslationModel0 = 0.200 ( 0.00 .. 1.00)
TranslationModel0 = 0.200 ( 0.00 .. 1.00)
TranslationModel1 = 1.000 ( 0.00 .. 1.00)
LM0 = 0.500 ( 0.00 .. 1.00)
featlist: WordPenalty0=-1
featlist: PhrasePenalty0=0.2
featlist: TranslationModel0=0.2
featlist: TranslationModel0=0.2
featlist: TranslationModel0=0.2
featlist: TranslationModel0=0.2
featlist: TranslationModel1=1
featlist: LM0=0.5
run 1 start at Sat Sep 1 04:57:35 EDT 2018
Parsing --decoder-flags: |-v 0|
Saving new config to: ./run1.moses.ini
Saved: ./run1.moses.ini
Normalizing lambdas: -1 0.2 0.2 0.2 0.2 0.2 1 0.5
DECODER_CFG = -weight-overwrite 'LM0= 0.142857 PhrasePenalty0= 0.057143
WordPenalty0= -0.285714 TranslationModel0= 0.057143 0.057143 0.057143
0.057143 TranslationModel1= 0.285714'
/home/arezoo1/mosesdecoder-master/mosesdecoder-master/bin/moses2 -v 0
-config /home/arezoo1/emlla/train/model/moses.ini -inputtype 3
-weight-overwrite 'LM0= 0.142857 PhrasePenalty0= 0.057143 WordPenalty0=
-0.285714 TranslationModel0= 0.057143 0.057143 0.057143 0.057143
TranslationModel1= 0.285714' -n-best-list run1.best100.out 100 distinct
-input-file /home/arezoo1/emlla/nc-dev2007.true.fr > run1.out
/home/arezoo1/mosesdecoder-master/mosesdecoder-master/bin/moses2 -v 0
-config /home/arezoo1/emlla/train/model/moses.ini -inputtype 3
-weight-overwrite 'LM0= 0.142857 PhrasePenalty0= 0.057143 WordPenalty0=
-0.285714 TranslationModel0= 0.057143 0.057143 0.057143 0.057143
TranslationModel1= 0.285714' -n-best-list run1.best100.out 100 distinct
-input-file /home/arezoo1/emlla/nc-dev2007.true.fr > run1.out
1-10.20.2 0.2 0.2 0.210.5(1) run decoder to produce n-best lists
params = -v 0
decoder_config = -weight-overwrite 'LM0= 0.142857 PhrasePenalty0= 0.057143
WordPenalty0= -0.285714 TranslationModel0= 0.057143 0.057143 0.057143
0.057143 TranslationModel1= 0.285714'
Starting...
START featureFunctions.Load()
Loading WordPenalty0
Finished loading WordPenalty0
Loading PhrasePenalty0
Finished loading PhrasePenalty0
Loading LM0
terminate called after throwing an instance of 'util::FDException'
what(): util/file.cc:175 in std::size_t util::PartialRead(int, void*,
std::size_t) threw FDException because `ret < 0'.
Is a directory in /home/arezoo1/emlla while reading 6 bytes in file /home/arezoo1/emlla
Aborted (core dumped)
Exit code: 134
The decoder died. CONFIG WAS -weight-overwrite 'LM0= 0.142857
PhrasePenalty0= 0.057143 WordPenalty0= -0.285714 TranslationModel0=
0.057143 0.057143 0.057143 0.057143 TranslationModel1= 0.285714'
/home/arezoo1/mosesdecoder-master/mosesdecoder-master/scripts/training/train-model.perl \
-root-dir train \-corpus /home/arezoo1/emlla/news-commentary-v8.fr-en.clean \-f fr -e en -alignment grow-diag-final-and -hierarchical -glue-grammar \ -lm 0:3:/home/arezoo1/emlla/news-commentary-v8.fr-en.blm.en \-mgiza -mgiza-cpus 4 \*-external-bin-dir */home/arezoo1/mosesdecoder-master/mosesdecoder-master*/tools >&training2.out*
/home/arezoo1/mosesdecoder-master/mosesdecoder-master/scripts/training/
mert-moses.pl /home/arezoo1/emlla/nc-dev2007.true.fr
/home/arezoo1/emlla/nc-dev2007.true.en
/home/arezoo1/mosesdecoder-master/mosesdecoder-master/bin/moses2
/home/arezoo1/emlla/train/model/moses.ini --rootdir
/home/arezoo1/mosesdecoder-master/mosesdecoder-master/scripts
--decoder-flags "-v 0" --no-filter-phrase-table --inputtype 3
--batch-mira --return-best-dev --filtercmd
'/home/arezoo1/mosesdecoder-master/mosesdecoder-master/scripts/training/
filter-model-given-input.pl' --batch-mira-args '-J 300' 1>&mert.out
Loading...