Skip to content
This repository was archived by the owner on Jul 22, 2024. It is now read-only.
This repository was archived by the owner on Jul 22, 2024. It is now read-only.

i want to change the hyper paramerters language model #14

@xiang-xiang-zhu

Description

@xiang-xiang-zhu

When I try to change the NUM_LAYERS in lstm_fedma_with_comm.py,it will have some problem,so i change the RNNmodel's hyper parameters nlayers.but still can't debug.
for example,when i change the NUM_LAYERS = 4(2-layer LSTM (4 layers: encoder|hidden LSTM1|hidden LSTM2|decoder)),so i change the nlayers=2.

Traceback (most recent call last):
File "language_oneshot_matching.py", line 504, in
matching_shapes=matching_shapes)
File "/home/hx/github/FedMA/language_modeling/language_fedma.py", line 258, in layerwise_fedma
reconstructed_bias = [split_bias(batch_weights[j][layer_index+3+2]) for j in range(J)]
File "/home/hx/github/FedMA/language_modeling/language_fedma.py", line 258, in
reconstructed_bias = [split_bias(batch_weights[j][layer_index+3+2]) for j in range(J)]
IndexError: list index out of range

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions