Skip to content

[Solution] How to run this project with Python 3.x and TensorFlow 1.x #30

New issue
New issue
Open
Open
[Solution] How to run this project with Python 3.x and TensorFlow 1.x#30
@Lotayou

Description

@Lotayou
Lotayou
opened on Jan 3, 2018

I spent 5 hours getting the program running, which is a great waste of time. I hereby summarize all the necessary changes for this project to run in Python 3.x and TensorFlow r1.x environment.

I assume your working directory is ~/StackGAN/StageI.

1. Python 3.x compatibility issues

In addition to minor changes mentioned in #2, there are still a major issue:

Pickle Issue: The original pickle files are created in Python 2.7, and open it with Python 3 could lead to the following error:
UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 1: ordinal not in range(128)
The solution can be found here: Unpickle Python 2 object in Python 3

2. TensorFlow r1.x compatibility issues

tf.concat() Issue #11: If you encounter error message like this:
TypeError: Expected int32, got <prettytensor.pretty_tensor_class.Layer object at 0x7f74d41abd90> of type 'Layer' instead.
In TensorFlow r0.12, the function is like
tf.concat(axis, value)
while in TensorFlow r1.x version the argument order has been changed:
tf.concat(value, axis)

PrettyTensor Issue #27: This issue is cause in PrettyTensor module with error message like this:
File ".../site-packages/prettytensor/pretty_tensor_class.py", line 1335, in _strip_unnecessary_contents_from_stack for f, line_no, method, _ in result._traceback: ValueError: too many values to unpack (expected 4)

This issue has nothing to do with PrettyTensor package version, I use the latest 0.7.4 but 0.6.2 should also work.

The main cause of this problem is in _traceback format, in TensorFlow r1.3 the _traceback object is a list with each entry a 6-tuple like this:
('D:\\Anaconda3\\envs\\tensorflow\\lib\\site-packages\\spyder\\utils\\ipython\\start_kernel.py', 241, '<module>', {'__name__': '__main__', '__doc__': '\nFile used to start kernels for the IPython Console\n', '__package__': None, '__loader__': <_frozen_importlib_external.SourceFileLoader object at 0x0000021474E75CF8>, '__spec__': None, '__annotations__': {}, '__builtins__': <module 'builtins' (built-in)>, '__file__': 'D:\\Anaconda3\\envs\\tensorflow\\lib\\site-packages\\spyder\\utils\\ipython\\start_kernel.py', '__cached__': None, 'os': <module 'os' from 'D:\\Anaconda3\\envs\\tensorflow\\lib\\os.py'>, 'osp': <module 'ntpath' from 'D:\\Anaconda3\\envs\\tensorflow\\lib\\ntpath.py'>, 'sys': <module 'sys' (built-in)>, 'IS_EXT_INTERPRETER': True, 'sympy_config': <function sympy_config at 0x00000214799891E0>, 'kernel_config': <function kernel_config at 0x0000021479989268>, 'varexp': <function varexp at 0x00000214799892F0>, 'main': <function main at 0x0000021479989378>}, 9, None)

I guess in TensorFlow r0.12 the entry only contains 4 elements. But anyway here's a quick workaround:

Change
for f, line_no, method, _ in result._traceback:
to
for f, line_no, method, *_ in result._traceback:
*_ takes any number of arguments and resolve whatever left in the unpacked tuple.

3. Summary Issue:
TensorFlow r1.3 has a new summary class so many code should be adapted like this:

tf.merge_all_summaries() -> tf.summary.merge_all()
tf.scalar_summary(k,v) -> tf.summary.scalar(k,v)
summary_writer = tf.train.SummaryWriter(self.log_dir, sess.graph) ->
summary_writer = tf.summary.FileWriter(self.log_dir, sess.graph)

4. Slicing Index Issue:
The index must be integer, so in dataset.py line 80 something should be changed:
# cropped_image =\ # images[i][w1: w1 + self._imsize, h1: h1 + self._imsize, :] original_image = images[i] cropped_image = original_image[int(w1): int(w1 + imsize),\ int(h1): int(h1 + imsize), :]

That's all the major compatibility issues that are necessary for training. Enjoy :)
image

Activity

Lotayou

Lotayou commented on Jan 3, 2018

@Lotayou
Lotayou
on Jan 3, 2018
Author

@hanzhanggit Can you please mention this in readme.md? Thanks!

SpadesQ

SpadesQ commented on Jan 11, 2018

@SpadesQ
SpadesQ
on Jan 11, 2018 · edited by SpadesQ

@Lotayou

After Change
for f, line_no, method, _ in result.traceback:
to
for f, line_no, method, * in result.traceback:
* takes any number of arguments and resolve whatever left in the unpacked tuple.

I got:
for f, line_no, method, *_ in result._traceback:
^
SyntaxError: invalid syntax

How to solve?

I use python2.7,how to solve

Lotayou

Lotayou commented on Jan 21, 2018

@Lotayou
Lotayou
on Jan 21, 2018
Author

@SpadesQ I use Python 3.6 myself so I don't know much about Python 2.7.

Maybe You should check if your _traceback file has the same format as mine (by print out its first entry like I did).

My traceback file contains 6 items per entry, but for loop only expectd 4 items, so I have to resolve the final items with *. If *_ does not work for you, just use some random variables to fill in the gap like this:

for f, line_no, method, blah1, blah2, blah3 in result._traceback:

BTW, This TensorFlow versions is a mess, I now use StackGANv2 PyTorch version.

KelvinBull

KelvinBull commented on Apr 4, 2018

@KelvinBull
KelvinBull
on Apr 4, 2018

Hello,why doesn't Prettytensor library include customs_fully_connected/custom_conv2d.
The version of tensorflow/Prettytensor is a bug?

ningning32

ningning32 commented on Apr 7, 2018

@ningning32
ningning32
on Apr 7, 2018

i am counter the same question @Lotayou , have you solve the question? really thank you

ningning32

ningning32 commented on Apr 7, 2018

@ningning32
ningning32
on Apr 7, 2018 · edited by ningning32

for f, line_no, method, blah1, blah2, blah3 in result._traceback:
ValueError: need more than 4 values to unpack
for f, line_no, method, blah1, blah2, blah3, blah4 in result._traceback:
ValueError: need more than 6 values to unpack
i used python2.7
@SpadesQ

KelvinBull

KelvinBull commented on May 3, 2018

@KelvinBull
KelvinBull
on May 3, 2018 · edited by KelvinBull

if you use python2.7 , you can do it by change your code curvely:
for all in result._traceback:
allist = list(all)[:3]
f = allist[0]
line_no = allist[1]
method = allist[2]

so, you can run ...

AnwarUllahKhan

AnwarUllahKhan commented on Nov 11, 2018

@AnwarUllahKhan
AnwarUllahKhan
on Nov 11, 2018

@Lotayou Dear Sir,
I am facing this problem

(base) C:\Users\anwar\Downloads\Programs\Text-to-Image-HighResolution>python run_exp.py --cfg cfg/birds.yml --gpu 0
Using config:
{'CONFIG_NAME': 'stageI',
'DATASET_NAME': 'birds',
'EMBEDDING_TYPE': 'cnn-rnn',
'GAN': {'DF_DIM': 64,
'EMBEDDING_DIM': 128,
'GF_DIM': 128,
'NETWORK_TYPE': 'default'},
'GPU_ID': 0,
'TEST': {'BATCH_SIZE': 64,
'CAPTION_PATH': '',
'HR_IMSIZE': 256,
'LR_IMSIZE': 64,
'NUM_COPY': 16,
'PRETRAINED_MODEL': ''},
'TRAIN': {'BATCH_SIZE': 64,
'B_WRONG': True,
'COEFF': {'KL': 2.0},
'COND_AUGMENTATION': True,
'DISCRIMINATOR_LR': 0.0002,
'FINETUNE_LR': False,
'FLAG': True,
'FT_LR_RETIO': 0.1,
'GENERATOR_LR': 0.0002,
'LR_DECAY_EPOCH': 50,
'MAX_EPOCH': 600,
'NUM_COPY': 4,
'NUM_EMBEDDING': 4,
'PRETRAINED_EPOCH': 600,
'PRETRAINED_MODEL': '',
'SNAPSHOT_INTERVAL': 2000},
'Z_DIM': 100}
images: (2933, 76, 76, 3)
embeddings: (2933, 10, 1024)
list_filenames: 2933 001.Black_footed_Albatross/Black_Footed_Albatross_0046_18
images: (8855, 76, 76, 3)
embeddings: (8855, 10, 1024)
list_filenames: 8855 002.Laysan_Albatross/Laysan_Albatross_0002_1027
Traceback (most recent call last):
File "run_exp.py", line 59, in
image_shape=dataset.image_shape
File "C:\Users\anwar\Downloads\Programs\Text-to-Image-HighResolution\model.py", line 31, in init
self.d_encode_img_template = self.d_encode_image()
File "C:\Users\anwar\Downloads\Programs\Text-to-Image-HighResolution\model.py", line 161, in d_encode_image
custom_conv2d(self.df_dim, k_h=4, k_w=4).
File "C:\ProgramData\Anaconda3\lib\site-packages\prettytensor\pretty_tensor_class.py", line 1965, in method
with _method_scope(input_layer, scope_name) as (scope, _):
File "C:\ProgramData\Anaconda3\lib\contextlib.py", line 81, in enter
return next(self.gen)
File "C:\ProgramData\Anaconda3\lib\site-packages\prettytensor\pretty_tensor_class.py", line 1776, in _method_scope
scopes.var_and_name_scope((name, None)) as (scope, var_scope):
File "C:\ProgramData\Anaconda3\lib\contextlib.py", line 81, in enter
return next(self.gen)
File "C:\ProgramData\Anaconda3\lib\site-packages\prettytensor\scopes.py", line 55, in var_and_name_scope
vs_key = tf.get_collection_ref(variable_scope._VARSCOPE_KEY)
AttributeError: module 'tensorflow.python.ops.variable_scope' has no attribute '_VARSCOPE_KEY'

AnwarUllahKhan

AnwarUllahKhan commented on Dec 24, 2018

@AnwarUllahKhan
AnwarUllahKhan
on Dec 24, 2018

@Lotayou @SpadesQ dear, I was training the model and putout the charger and goes out side when i came the my system is switch off, so now how can I continue my model again from that checkpoint? help me please, Thank you very much

Lotayou

Lotayou commented on Dec 24, 2018

@Lotayou
Lotayou
on Dec 24, 2018
Author

@AnwarUllahKhan I guess there must be a parameter in config file where you can designate the ckpt file to be loaded for subseqeuent training. However if you cannot find one, try convert your tensorflow checkpoint to a pytorch one, and go to the pytorch implementation instead:)

AnwarUllahKhan

AnwarUllahKhan commented on Dec 27, 2018

@AnwarUllahKhan
AnwarUllahKhan
on Dec 27, 2018

@Lotayou thank you I solve that. I successfully train this now but how can I run demo which is .sh file and I am on the windows....?

guwalgiya

guwalgiya commented on Jan 8, 2019

@guwalgiya
guwalgiya
on Jan 8, 2019

saved me so much time! thanks!

ankit01ojha

ankit01ojha commented on Feb 21, 2019

@ankit01ojha
ankit01ojha
on Feb 21, 2019 · edited by ankit01ojha

@AnwarUllahKhan could you please elaborate on how you fixed it, I am also facing the same problem. And if you have made this project work on windows could you also tell me how you ran the shell script.
@Lotayou could you also help me.

akhilvasvani

akhilvasvani commented on Jun 22, 2019

@akhilvasvani
akhilvasvani
on Jun 22, 2019 · edited by akhilvasvani

@Lotayou @AnwarUllahKhan @ankit01ojha, I am also facing the same problem with prettytensor for python3.6.

Problem:

python3 stageI/run_exp.py --cfg stageI/cfg/birds.yml --gpu 0
./misc/config.py:100: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details.
  yaml_cfg = edict(yaml.load(f))
Using config:
{'CONFIG_NAME': 'stageI',
 'DATASET_NAME': 'birds',
 'EMBEDDING_TYPE': 'cnn-rnn',
 'GAN': {'DF_DIM': 64,
         'EMBEDDING_DIM': 128,
         'GF_DIM': 128,
         'NETWORK_TYPE': 'default'},
 'GPU_ID': 0,
 'TEST': {'BATCH_SIZE': 64,
          'CAPTION_PATH': '',
          'HR_IMSIZE': 256,
          'LR_IMSIZE': 64,
          'NUM_COPY': 16,
          'PRETRAINED_MODEL': ''},
 'TRAIN': {'BATCH_SIZE': 64,
           'B_WRONG': True,
           'COEFF': {'KL': 2.0},
           'COND_AUGMENTATION': True,
           'DISCRIMINATOR_LR': 0.0002,
           'FINETUNE_LR': False,
           'FLAG': True,
           'FT_LR_RETIO': 0.1,
           'GENERATOR_LR': 0.0002,
           'LR_DECAY_EPOCH': 50,
           'MAX_EPOCH': 600,
           'NUM_COPY': 4,
           'NUM_EMBEDDING': 4,
           'PRETRAINED_EPOCH': 600,
           'PRETRAINED_MODEL': '',
           'SNAPSHOT_INTERVAL': 2000},
 'Z_DIM': 100}
images:  (2933, 76, 76, 3)
embeddings:  (2933, 10, 1024)
list_filenames:  2933 001.Black_footed_Albatross/Black_Footed_Albatross_0046_18
images:  (8855, 76, 76, 3)
embeddings:  (8855, 10, 1024)
list_filenames:  8855 002.Laysan_Albatross/Laysan_Albatross_0002_1027
Traceback (most recent call last):
  File "stageI/run_exp.py", line 63, in <module>
    image_shape=dataset.image_shape
  File "/home/akhil/StackGAN/stageI/model.py", line 35, in __init__
    self.d_encode_img_template = self.d_encode_image()
  File "/home/akhil/StackGAN/stageI/model.py", line 165, in d_encode_image
    custom_conv2d(self.df_dim, k_h=4, k_w=4).
  File "/usr/local/lib/python3.6/dist-packages/prettytensor/pretty_tensor_class.py", line 1965, in method
    with _method_scope(input_layer, scope_name) as (scope, _):
  File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__
    return next(self.gen)
  File "/usr/local/lib/python3.6/dist-packages/prettytensor/pretty_tensor_class.py", line 1776, in _method_scope
    scopes.var_and_name_scope((name, None)) as (scope, var_scope):
  File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__
    return next(self.gen)
  File "/usr/local/lib/python3.6/dist-packages/prettytensor/scopes.py", line 55, in var_and_name_scope
    vs_key = tf.get_collection_ref(variable_scope._VARSCOPE_KEY)
AttributeError: module 'tensorflow.python.ops.variable_scope' has no attribute '_VARSCOPE_KEY'

How did you fix it?

AnwarUllahKhan

AnwarUllahKhan commented on Jun 22, 2019

@AnwarUllahKhan
AnwarUllahKhan
on Jun 22, 2019

@akhilvasvani @ankit01ojha you both are using python 3+ so follow the instruction of @Lotayou first message...

14 remaining items

Loading
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

      Development

      No branches or pull requests

        Participants

        @akhilvasvani@SpadesQ@ankit01ojha@guwalgiya@KelvinBull

        Issue actions
          [Solution] How to run this project with Python 3.x and TensorFlow 1.x · Issue #30 · hanzhanggit/StackGAN