Giters

udibr / headlines

Automatically generate headlines to short articles

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

some questions for training model

UB1010 opened this issue · comments

commented

Hi, udibr,
I was running your code with the data of reuters news, the vocabulary-embedding.ipynb is OK for everything.
train.ipynb also is OK, but with a warning, and too slow to train the model.
I have some questions:
1, How to read the file train.history.pkl? i want to check the history of trainning.
2, I was running predict.ipynb with the model only training 5 iteration, but find a wrong message: "failed to find layer timedistributed_1 in model " when load the model. Why got the wrong message?
3, I find the predict result is not good with the model by 5 iteration. How many iteration that is fine for the result is just OK? I have more than 3K news for training model in CPU, 500 iteration is too slow.

Thank you.

commented
  1. just check the code which wrote the history (last cell of train notebook)
  2. This message is OK, I decided not to load the entire model but just the part below the top dense layer, so this is why you see this message. However the weights are returned from the load function and I latter use them directly.
  3. I think 3K examples is not enough. Try to get at least two order of magnitude more data.
    I guess its time to move to using GPU...
commented

Hi @udibr , I am also running the train notebook and I have one question regarding the line:

if FN1:
    model.load_weights('data/train.hdf5')

If its the first time that I am about to train the model, should model.load_weights('data/train.hdf5') be executed? If that's the case, when is that weights file generated? That path doesn't find the file on my machine.

Thanks a lot

commented

there was a small bug in code which I now updated. In any case on first run FN1 should be None and no load should be made

commented

Thank you for your response.
I want to run the code by Chinese text, can you guide something? Get a new Word Embedding by Chinese, must use GloVe? Can I use another model? Other matters?