Serialization errors

[musm]

julia> versioninfo()
Julia Version 1.1.0
Commit 80516ca202 (2019-01-21 21:24 UTC)
Platform Info:
  OS: Windows (x86_64-w64-mingw32)
  CPU: Intel(R) Core(TM) i7-4510U CPU @ 2.00GHz
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-6.0.1 (ORCJIT, haswell)
Environment:
  JULIA_EDITOR = subl
  JULIA_NUM_THREADS = 4

julia> using PackageCompiler; PackageCompiler.compile_incremental(:DataFrames)

[ Info: used 8899 out of 8899 precompile statements
┌ Info: activating new environment at C:\Users\Mus\.julia\packages\PackageCompiler\oT98U\packages\Project.toml.
└ @ Pkg.API C:\cygwin\home\Administrator\buildbot\worker\package_win64\build\usr\share\julia\stdlib\v1.1\Pkg\src\API.jl:519
  Updating registry at `C:\Users\Mus\.julia\registries\General`
  Updating git-repo `https://github.com/JuliaRegistries/General.git`
fatal: error thrown and no exception handler available.
ErrorException("Task cannot be serialized")
rec_backtrace at /home/Administrator/buildbot/worker/package_win64/build/src\stackwalk.c:94
record_backtrace at /home/Administrator/buildbot/worker/package_win64/build/src\task.c:217 [inlined]
jl_throw at /home/Administrator/buildbot/worker/package_win64/build/src\task.c:417
jl_error at /home/Administrator/buildbot/worker/package_win64/build/src\rtutils.c:41
jl_serialize_value_ at /home/Administrator/buildbot/worker/package_win64/build/src\staticdata.c:294
jl_serialize_value_ at /home/Administrator/buildbot/worker/package_win64/build/src\staticdata.c:252 [inlined]
jl_serialize_value_ at /home/Administrator/buildbot/worker/package_win64/build/src\staticdata.c:286
jl_serialize_value_ at /home/Administrator/buildbot/worker/package_win64/build/src\staticdata.c:252 [inlined]
jl_serialize_module at /home/Administrator/buildbot/worker/package_win64/build/src\staticdata.c:230 [inlined]
jl_serialize_value_ at /home/Administrator/buildbot/worker/package_win64/build/src\staticdata.c:291
jl_serialize_value_ at /home/Administrator/buildbot/worker/package_win64/build/src\julia.h:915 [inlined]
jl_serialize_value_ at /home/Administrator/buildbot/worker/package_win64/build/src\staticdata.c:303
jl_serialize_value_ at /home/Administrator/buildbot/worker/package_win64/build/src\julia.h:915 [inlined]
jl_serialize_value_ at /home/Administrator/buildbot/worker/package_win64/build/src\staticdata.c:303
jl_serialize_value_ at /home/Administrator/buildbot/worker/package_win64/build/src\staticdata.c:252 [inlined]
jl_serialize_value_ at /home/Administrator/buildbot/worker/package_win64/build/src\staticdata.c:286
jl_serialize_value_ at /home/Administrator/buildbot/worker/package_win64/build/src\julia.h:915 [inlined]
jl_serialize_value_ at /home/Administrator/buildbot/worker/package_win64/build/src\staticdata.c:303
jl_serialize_value_ at /home/Administrator/buildbot/worker/package_win64/build/src\julia.h:915 [inlined]
jl_serialize_value_ at /home/Administrator/buildbot/worker/package_win64/build/src\staticdata.c:303
jl_serialize_value_ at /home/Administrator/buildbot/worker/package_win64/build/src\julia.h:915 [inlined]
jl_serialize_value_ at /home/Administrator/buildbot/worker/package_win64/build/src\staticdata.c:303
jl_serialize_value_ at /home/Administrator/buildbot/worker/package_win64/build/src\julia.h:915 [inlined]
jl_serialize_value_ at /home/Administrator/buildbot/worker/package_win64/build/src\staticdata.c:303
jl_serialize_value_ at /home/Administrator/buildbot/worker/package_win64/build/src\julia.h:915 [inlined]
jl_serialize_value_ at /home/Administrator/buildbot/worker/package_win64/build/src\staticdata.c:303
jl_serialize_value_ at /home/Administrator/buildbot/worker/package_win64/build/src\julia.h:915 [inlined]
jl_serialize_value_ at /home/Administrator/buildbot/worker/package_win64/build/src\staticdata.c:303
jl_serialize_value_ at /home/Administrator/buildbot/worker/package_win64/build/src\staticdata.c:252 [inlined]
jl_serialize_module at /home/Administrator/buildbot/worker/package_win64/build/src\staticdata.c:230 [inlined]
jl_serialize_value_ at /home/Administrator/buildbot/worker/package_win64/build/src\staticdata.c:291
jl_serialize_module at /home/Administrator/buildbot/worker/package_win64/build/src\staticdata.c:222 [inlined]
jl_serialize_value_ at /home/Administrator/buildbot/worker/package_win64/build/src\staticdata.c:291
jl_serialize_value_ at /home/Administrator/buildbot/worker/package_win64/build/src\staticdata.c:337 [inlined]
jl_save_system_image_to_stream at /home/Administrator/buildbot/worker/package_win64/build/src\staticdata.c:1273
jl_create_system_image at /home/Administrator/buildbot/worker/package_win64/build/src\staticdata.c:1378
jl_write_compiler_output at /home/Administrator/buildbot/worker/package_win64/build/src\precompile.c:76
jl_atexit_hook at /home/Administrator/buildbot/worker/package_win64/build/src/home/Administrator/buildbot/worker/package_win64/build/src\init.c:222
wmain at /home/Administrator/buildbot/worker/package_win64/build/ui\repl.c:218
__tmainCRTStartup at /usr/src/debug/mingw64-x86_64-runtime-5.0.3-1/crt\crtexe.c:329
mainCRTStartup at /usr/src/debug/mingw64-x86_64-runtime-5.0.3-1/crt\crtexe.c:212
BaseThreadInitThunk at C:\WINDOWS\System32\KERNEL32.DLL (unknown line)
RtlUserThreadStart at C:\WINDOWS\SYSTEM32\ntdll.dll (unknown line)
ERROR: failed process: Process(`'C:\tools\Julia\julia-1.x\bin\julia.exe' --optimize=3 '--output-o=C:\Users\Mus\.julia\packages\PackageCompiler\oT98U\sysimg\sys.a' -g1 --track-allocation=none --startup-file=no --code-coverage=none --history-file=yes --inline=yes --math-mode=ieee --handle-signals=yes --warn-overwrite=no --compile=yes --depwarn=yes --cpu-target=native --track-allocation=none --sysimage-native-code=yes '--sysimage=C:\tools\Julia\julia-1.x\lib\julia\sys.dll' -g1 --compiled-modules=yes --optimize=2 'C:\Users\Mus\.julia\packages\PackageCompiler\oT98U\sysimg\run_julia_code.jl'`, ProcessExited(1)) [1]
Stacktrace:
 [1] error(::String, ::Base.Process, ::String, ::Int64, ::String) at .\error.jl:42
 [2] pipeline_error at .\process.jl:785 [inlined]
 [3] #run#515(::Bool, ::Function, ::Cmd) at .\process.jl:726
 [4] run at .\process.jl:724 [inlined]
 [5] #run_julia#1 at C:\Users\Mus\.julia\packages\PackageCompiler\oT98U\src\compiler_flags.jl:225 [inlined]
 [6] #run_julia at .\none:0 [inlined]
 [7] #compile_incremental#62(::Bool, ::Bool, ::Bool, ::Nothing, ::Function, ::String, ::String) at C:\Users\Mus\.julia\packages\PackageCompiler\oT98U\src\incremental.jl:82
 [8] compile_incremental at C:\Users\Mus\.julia\packages\PackageCompiler\oT98U\src\incremental.jl:79 [inlined]
 [9] #compile_incremental#63 at C:\Users\Mus\.julia\packages\PackageCompiler\oT98U\src\incremental.jl:109 [inlined]
 [10] compile_incremental(::Symbol) at C:\Users\Mus\.julia\packages\PackageCompiler\oT98U\src\incremental.jl:108
 [11] top-level scope at none:0

[SimonDanisch]

I can't reproduce!
Julia 1.1, with DataFrames 0.17

[musm]

Very strange. I have no idea why PackageCompiler fails on every package I have tried to use it with!
There's nothing special about my Julia installation...

[SimonDanisch]

hm, it seems pretty fragile... I had lots and lots of frustration to get it to a sort of stable state, to compile the packages I want -.- So not too surprising :(

[classner]

@musm I'm currently getting the same error with julia v1.0.3 as well as v1.1, trying to precompile LanguageServer.jl in my case. My error is

Julia program file:
  "/home/chris/.julia/packages/PackageCompiler/oT98U/sysimg/precompile.jl"
Build directory:
  "/home/chris/.julia/packages/PackageCompiler/oT98U/sysimg"
┌ Info: activating new environment at ~/.julia/packages/PackageCompiler/oT98U/packages/Project.toml.
└ @ Pkg.API /buildworker/worker/package_linux64/build/usr/share/julia/stdlib/v1.0/Pkg/src/API.jl:600
  Updating registry at `~/.julia/registries/General`
  Updating git-repo `https://github.com/JuliaRegistries/General.git`
fatal: error thrown and no exception handler available.
ErrorException("Task cannot be serialized")
rec_backtrace at /buildworker/worker/package_linux64/build/src/stackwalk.c:94
record_backtrace at /buildworker/worker/package_linux64/build/src/task.c:246
jl_throw at /buildworker/worker/package_linux64/build/src/task.c:577
jl_error at /buildworker/worker/package_linux64/build/src/rtutils.c:41
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/staticdata.c:293
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/staticdata.c:285
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/julia.h:894 [inlined]
jl_serialize_module at /buildworker/worker/package_linux64/build/src/staticdata.c:229 [inlined]
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/staticdata.c:290
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/staticdata.c:251 [inlined]
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/staticdata.c:302
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/staticdata.c:251 [inlined]
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/staticdata.c:302
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/staticdata.c:285
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/staticdata.c:251 [inlined]
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/staticdata.c:302
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/staticdata.c:251 [inlined]
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/staticdata.c:302
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/staticdata.c:251 [inlined]
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/staticdata.c:302
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/staticdata.c:251 [inlined]
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/staticdata.c:302
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/staticdata.c:251 [inlined]
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/staticdata.c:302
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/julia.h:894 [inlined]
jl_serialize_module at /buildworker/worker/package_linux64/build/src/staticdata.c:229 [inlined]
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/staticdata.c:290
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/julia.h:894 [inlined]
jl_serialize_module at /buildworker/worker/package_linux64/build/src/staticdata.c:229 [inlined]
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/staticdata.c:290
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/julia.h:894 [inlined]
jl_serialize_module at /buildworker/worker/package_linux64/build/src/staticdata.c:229 [inlined]
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/staticdata.c:290
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/julia.h:894 [inlined]
jl_serialize_module at /buildworker/worker/package_linux64/build/src/staticdata.c:221 [inlined]
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/staticdata.c:290
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/staticdata.c:336 [inlined]
jl_save_system_image_to_stream at /buildworker/worker/package_linux64/build/src/staticdata.c:1272
jl_create_system_image at /buildworker/worker/package_linux64/build/src/staticdata.c:1377
jl_write_compiler_output at /buildworker/worker/package_linux64/build/src/precompile.c:68
jl_atexit_hook at /buildworker/worker/package_linux64/build/src/init.c:233
main at /buildworker/worker/package_linux64/build/ui/repl.c:234
__libc_start_main at /build/glibc-B9XfQf/glibc-2.28/csu/../csu/libc-start.c:308
_start at /home/chris/programming/julia-1.0.3/bin/julia (unknown line)
ERROR: failed process: Process(`/home/chris/programming/julia-1.0.3/bin/julia --sysimage=/home/chris/.julia/packages/PackageCompiler/oT98U/sysimg/backup/native/sys.so --output-o=sys.a --track-allocation=none --code-coverage=none --history-file=yes --inline=yes --math-mode=ieee --compile=yes --track-allocation=none --sysimage-native-code=yes --sysimage=/home/chris/programming/julia-1.0.3/lib/julia/sys.so --compiled-modules=yes --optimize=2 /home/chris/.julia/packages/PackageCompiler/oT98U/sysimg/run_julia_code.jl`, ProcessExited(1)) [1]

@SimonDanisch : what did you do to get it working?

[pfitzseb]

For me those errors only happen when you've added PackageCompiler.jl as opposed to deving it, so try that as a short term solution.

[alandion]

I also have this problem with any package, whether I add or dev. I found a workaround by preventing snoop and snoop_packages from writing Pkg.instantiate() to the precompile file. That is, I removed lines 16 and 119 from snooping.jl
@SimonDanisch is it really necessary to call Pkg.instantiate() in the precompile?

EDIT: one more thing -- after doing the above modification, julia starts up in a project called PackagesPrecompile. adding using Pkg;Pkg.activate() to my startup file gets me back to the default project

[tkf]

I'm seeing the same issue. Running compile_package("PyCall") and compile_incremental(:PyCall) fail with the following error

[ Info: used 1897 out of 1897 precompile statements
Julia program file:
  "/home/takafumi/.julia/packages/PackageCompiler/oT98U/sysimg/precompile.jl"
Build directory:
  "/home/takafumi/.julia/packages/PackageCompiler/oT98U/sysimg"
┌ Info: activating new environment at ~/.julia/packages/PackageCompiler/oT98U/packages/Project.toml.
└ @ Pkg.API /buildworker/worker/package_linux64/build/usr/share/julia/stdlib/v1.1/Pkg/src/API.jl:519
  Updating registry at `~/.julia/registries/General`
  Updating git-repo `https://github.com/JuliaRegistries/General.git`
fatal: error thrown and no exception handler available.
ErrorException("Task cannot be serialized")
rec_backtrace at /buildworker/worker/package_linux64/build/src/stackwalk.c:94
record_backtrace at /buildworker/worker/package_linux64/build/src/task.c:217 [inlined]
jl_throw at /buildworker/worker/package_linux64/build/src/task.c:417
jl_error at /buildworker/worker/package_linux64/build/src/rtutils.c:41
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/staticdata.c:294
...
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/staticdata.c:337 [inlined]
jl_save_system_image_to_stream at /buildworker/worker/package_linux64/build/src/staticdata.c:1273
jl_create_system_image at /buildworker/worker/package_linux64/build/src/staticdata.c:1378
jl_write_compiler_output at /buildworker/worker/package_linux64/build/src/precompile.c:76
jl_atexit_hook at /buildworker/worker/package_linux64/build/src/init.c:222
main at /buildworker/worker/package_linux64/build/ui/repl.c:218
__libc_start_main at /usr/lib/libc.so.6 (unknown line)
_start at /home/takafumi/opt/julia/julia-1.1.0/bin/julia (unknown line)

in Julia 1.1. Interestingly, in Julia 1.2.0-DEV.339, I get a different error

[ Info: used 1810 out of 1810 precompile statements
Julia program file:
  "/home/takafumi/.julia/dev/PackageCompiler/sysimg/precompile.jl"
Build directory:
  "/home/takafumi/.julia/dev/PackageCompiler/sysimg"
┌ Info: activating new environment at ~/.julia/dev/PackageCompiler/packages/Project.toml.
└ @ Pkg.API /home/takafumi/repos/watch/julia/usr/share/julia/stdlib/v1.2/Pkg/src/API.jl:519
  Updating registry at `~/.julia/registries/General`
  Updating git-repo `https://github.com/JuliaRegistries/General.git`
ptrtoint not supported for non-integral pointers
inttoptr not supported for non-integral pointers
LLVM ERROR: Broken function found, compilation aborted!

Tested with PackageCompiler v0.6.3 and master and PyCall master.

Full output from Julia 1.2.0-DEV.339

julia> compile_package("PyCall")
[ Info: Registered package PyCall, using already given UUID: 438e738f-606a-5dbb-bf0a-cddfbfd45ab0
  Updating registry at `~/.julia/registries/General`
  Updating git-repo `https://github.com/JuliaRegistries/General.git`
 Resolving package versions...
  Updating `~/.julia/dev/PackageCompiler/packages/PyCall/Project.toml`
  [8f4d0f93] + Conda v1.2.0
  [1914dd2f] + MacroTools v0.4.5
  [81def892] + VersionParsing v1.1.3
  [ade2ca70] + Dates
  [8f399da3] + Libdl
  [37e2e46d] + LinearAlgebra
  [9e88b42a] + Serialization
  [10745b16] + Statistics
  Updating `~/.julia/dev/PackageCompiler/packages/PyCall/Manifest.toml`
  [34da2185] + Compat v1.5.1
  [8f4d0f93] + Conda v1.2.0
  [682c06a0] + JSON v0.20.0
  [1914dd2f] + MacroTools v0.4.5
  [81def892] + VersionParsing v1.1.3
  [2a0f44e3] + Base64
  [ade2ca70] + Dates
  [8bb1440f] + DelimitedFiles
  [8ba89e20] + Distributed
  [b77e0a4c] + InteractiveUtils
  [76f85450] + LibGit2
  [8f399da3] + Libdl
  [37e2e46d] + LinearAlgebra
  [56ddb016] + Logging
  [d6f4376e] + Markdown
  [a63ad114] + Mmap
  [44cfe95a] + Pkg
  [de0858da] + Printf
  [3fa0cd96] + REPL
  [9a3f8284] + Random
  [ea8e919c] + SHA
  [9e88b42a] + Serialization
  [1a1011a3] + SharedArrays
  [6462fe0b] + Sockets
  [2f01184e] + SparseArrays
  [10745b16] + Statistics
  [8dfed614] + Test
  [cf7118a7] + UUIDs
  [4ec0a83e] + Unicode
 Resolving package versions...
  Updating `~/.julia/dev/PackageCompiler/packages/PyCall/Project.toml`
  [9b87118b] + PackageCompiler v0.6.3
  [44cfe95a] + Pkg
  Updating `~/.julia/dev/PackageCompiler/packages/PyCall/Manifest.toml`
  [c7e460c6] + ArgParse v0.6.1
  [9e28174c] + BinDeps v0.8.10
  [b99e7846] + BinaryProvider v0.5.3
  [e1450e63] + BufferedStreams v1.0.0
  [0862f596] + HTTPClient v0.2.1
  [b27032c2] + LibCURL v0.4.1
  [522f3ed2] + LibExpat v0.5.0
  [2ec943e9] + Libz v1.0.0
  [9b87118b] + PackageCompiler v0.6.3
  [b718987f] + TextWrap v0.3.0
  [30578b45] + URIParser v0.4.0
  [c17dfb99] + WinRPM v0.4.2
[ Info: activating new environment at ~/.julia/dev/PackageCompiler/packages/PyCall/Project.toml.
  Updating registry at `~/.julia/registries/General`
  Updating git-repo `https://github.com/JuliaRegistries/General.git`
┌ Info: Python version 3.7.0 from /usr/lib/libpython3.7m.so.1.0, PYTHONHOME=/home/takafumi/.virtualenvs/julia:/home/takafumi/.virtualenvs/julia
│ ENV[PYTHONPATH]=
│ ENV[PYTHONHOME]=
└ ENV[PYTHONEXECUTABLE]=
Test Summary: | Pass  Total
PyCall        |  443    443
Test Summary: | Pass  Total
pydef         |    8      8
Test Summary: | Pass  Total
callback      |    3      3
Test Summary: | Pass  Total
throwing show |    4      4
Test Summary: | Pass  Total
PyIterator    |   14     14
Test Summary: | Pass  Total
atexit        |    1      1
Test Summary: | Pass  Total
pycall!       |   16     16
Test Summary: | Pass  Total
PyBuffer      |   81     81
Running virtualenv with interpreter /usr/bin/python3.7
Using base prefix '/usr'
/usr/lib/python3.7/site-packages/virtualenv.py:1039: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
  import imp
New python executable in /tmp/tmpjliv0M/ϵνιℓ/bin/python3.7
Also creating executable in /tmp/tmpjliv0M/ϵνιℓ/bin/python
Installing setuptools, pip, wheel...done.
Test Summary:         | Pass  Total
virtualenv activation |    4      4
Test Summary:   | Pass  Total
venv activation |    4      4
[ Info: used 1810 out of 1810 precompile statements
Julia program file:
  "/home/takafumi/.julia/dev/PackageCompiler/sysimg/precompile.jl"
Build directory:
  "/home/takafumi/.julia/dev/PackageCompiler/sysimg"
┌ Info: activating new environment at ~/.julia/dev/PackageCompiler/packages/Project.toml.
└ @ Pkg.API /home/takafumi/repos/watch/julia/usr/share/julia/stdlib/v1.2/Pkg/src/API.jl:519
  Updating registry at `~/.julia/registries/General`
  Updating git-repo `https://github.com/JuliaRegistries/General.git`
ptrtoint not supported for non-integral pointers
inttoptr not supported for non-integral pointers
LLVM ERROR: Broken function found, compilation aborted!
ERROR: failed process: Process(`/home/takafumi/repos/watch/julia/usr/bin/julia --sysimage=/home/takafumi/.julia/dev/PackageCompiler/sysimg/backup/native/sys.so --output-o=sys.a --track-allocation=none --code-coverage=none --history-file=yes --inline=yes --math-mode=ieee --compile=yes --track-allocation=none --sysimage-native-code=yes --sysimage=/home/takafumi/repos/watch/julia/usr/lib/julia/sys.so --compiled-modules=yes --optimize=2 /home/takafumi/.julia/dev/PackageCompiler/sysimg/run_julia_code.jl`, ProcessExited(1)) [1]
Stacktrace:
 [1] error(::String, ::Base.Process, ::String, ::Int64, ::String) at ./error.jl:42
 [2] pipeline_error at ./process.jl:786 [inlined]
 [3] #run#515(::Bool, ::typeof(run), ::Cmd) at ./process.jl:727
 [4] run at ./process.jl:725 [inlined]
 [5] #run_julia#1 at /home/takafumi/.julia/dev/PackageCompiler/src/compiler_flags.jl:225 [inlined]
 [6] #run_julia at ./none:0 [inlined]
 [7] (::getfield(PackageCompiler, Symbol("##13#14")){Base.Iterators.Pairs{Symbol,Any,NTuple{14,Symbol},NamedTuple{(:sysimage, :startup_file, :handle_signals, :sysimage_native_code, :compiled_modules, :depwarn, :warn_overwrite, :compile, :cpu_target, :optimize, :debug_level, :inline, :check_bounds, :math_mode),Tuple{String,Nothing,Nothing,Nothing,Nothing,Nothing,Nothing,Nothing,Nothing,Nothing,Nothing,Nothing,Nothing,Nothing}}},String})() at /home/takafumi/.julia/dev/PackageCompiler/src/static_julia.jl:262
 [8] cd(::getfield(PackageCompiler, Symbol("##13#14")){Base.Iterators.Pairs{Symbol,Any,NTuple{14,Symbol},NamedTuple{(:sysimage, :startup_file, :handle_signals, :sysimage_native_code, :compiled_modules, :depwarn, :warn_overwrite, :compile, :cpu_target, :optimize, :debug_level, :inline, :check_bounds, :math_mode),Tuple{String,Nothing,Nothing,Nothing,Nothing,Nothing,Nothing,Nothing,Nothing,Nothing,Nothing,Nothing,Nothing,Nothing}}},String}, ::String) at ./file.jl:96
 [9] #build_object#12(::Base.Iterators.Pairs{Symbol,Any,NTuple{14,Symbol},NamedTuple{(:sysimage, :startup_file, :handle_signals, :sysimage_native_code, :compiled_modules, :depwarn, :warn_overwrite, :compile, :cpu_target, :optimize, :debug_level, :inline, :check_bounds, :math_mode),Tuple{String,Nothing,Nothing,Nothing,Nothing,Nothing,Nothing,Nothing,Nothing,Nothing,Nothing,Nothing,Nothing,Nothing}}}, ::typeof(PackageCompiler.build_object), ::String, ::String, ::String, ::Bool) at /home/takafumi/.julia/dev/PackageCompiler/src/static_julia.jl:261
 [10] #build_object at ./none:0 [inlined]
 [11] build_object(::String, ::String, ::String, ::Bool, ::String, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing) at /home/takafumi/.julia/dev/PackageCompiler/src/static_julia.jl:240
 [12] #static_julia#5(::Nothing, ::Bool, ::Bool, ::String, ::String, ::Nothing, ::Bool, ::Bool, ::Bool, ::Bool, ::Bool, ::Bool, ::Bool, ::Bool, ::Nothing, ::Bool, ::Bool, ::String, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::typeof(static_julia), ::String) at /home/takafumi/.julia/dev/PackageCompiler/src/static_julia.jl:161
 [13] #static_julia at ./none:0 [inlined]
 [14] #build_sysimg#29(::Bool, ::Bool, ::Bool, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::typeof(PackageCompiler.build_sysimg), ::String, ::String) at /home/takafumi/.julia/dev/PackageCompiler/src/api.jl:25
 [15] #build_sysimg at ./none:0 [inlined]
 [16] #compile_package#67(::Bool, ::Bool, ::Bool, ::Nothing, ::Bool, ::typeof(compile_package), ::Tuple{String,String}) at /home/takafumi/.julia/dev/PackageCompiler/src/PackageCompiler.jl:130
 [17] #compile_package#64 at /home/takafumi/.julia/dev/PackageCompiler/src/PackageCompiler.jl:116 [inlined]
 [18] compile_package(::String) at /home/takafumi/.julia/dev/PackageCompiler/src/PackageCompiler.jl:88
 [19] top-level scope at REPL[2]:1

Full output from Julia 1.1

julia> compile_package("PyCall")
[ Info: Recompiling stale cache file /home/takafumi/.julia/compiled/v1.1/PyCall/GkzkC.ji for PyCall [438e738f-606a-5dbb-bf0a-cddfbfd45ab0]
[ Info: Registered package PyCall, using already given UUID: 438e738f-606a-5dbb-bf0a-cddfbfd45ab0
  Updating registry at `~/.julia/registries/General`
  Updating git-repo `https://github.com/JuliaRegistries/General.git`
 Resolving package versions...
  Updating `~/.julia/packages/PackageCompiler/oT98U/packages/PyCall/Project.toml`
  [8f4d0f93] + Conda v1.2.0
  [1914dd2f] + MacroTools v0.4.5
  [81def892] + VersionParsing v1.1.3
  [ade2ca70] + Dates
  [8f399da3] + Libdl
  [37e2e46d] + LinearAlgebra
  [9e88b42a] + Serialization
  [10745b16] + Statistics
  Updating `~/.julia/packages/PackageCompiler/oT98U/packages/PyCall/Manifest.toml`
  [34da2185] + Compat v1.5.1
  [8f4d0f93] + Conda v1.2.0
  [682c06a0] + JSON v0.20.0
  [1914dd2f] + MacroTools v0.4.5
  [81def892] + VersionParsing v1.1.3
  [2a0f44e3] + Base64
  [ade2ca70] + Dates
  [8bb1440f] + DelimitedFiles
  [8ba89e20] + Distributed
  [b77e0a4c] + InteractiveUtils
  [76f85450] + LibGit2
  [8f399da3] + Libdl
  [37e2e46d] + LinearAlgebra
  [56ddb016] + Logging
  [d6f4376e] + Markdown
  [a63ad114] + Mmap
  [44cfe95a] + Pkg
  [de0858da] + Printf
  [3fa0cd96] + REPL
  [9a3f8284] + Random
  [ea8e919c] + SHA
  [9e88b42a] + Serialization
  [1a1011a3] + SharedArrays
  [6462fe0b] + Sockets
  [2f01184e] + SparseArrays
  [10745b16] + Statistics
  [8dfed614] + Test
  [cf7118a7] + UUIDs
  [4ec0a83e] + Unicode
 Resolving package versions...
  Updating `~/.julia/packages/PackageCompiler/oT98U/packages/PyCall/Project.toml`
  [9b87118b] + PackageCompiler v0.6.3
  [44cfe95a] + Pkg
  Updating `~/.julia/packages/PackageCompiler/oT98U/packages/PyCall/Manifest.toml`
  [c7e460c6] + ArgParse v0.6.1
  [9e28174c] + BinDeps v0.8.10
  [b99e7846] + BinaryProvider v0.5.3
  [e1450e63] + BufferedStreams v1.0.0
  [0862f596] + HTTPClient v0.2.1
  [b27032c2] + LibCURL v0.4.1
  [522f3ed2] + LibExpat v0.5.0
  [2ec943e9] + Libz v1.0.0
  [9b87118b] + PackageCompiler v0.6.3
  [b718987f] + TextWrap v0.3.0
  [30578b45] + URIParser v0.4.0
  [c17dfb99] + WinRPM v0.4.2
[ Info: activating new environment at ~/.julia/packages/PackageCompiler/oT98U/packages/PyCall/Project.toml.
  Updating registry at `~/.julia/registries/General`
  Updating git-repo `https://github.com/JuliaRegistries/General.git`
┌ Info: Python version 3.7.0 from /usr/lib/libpython3.7m.so.1.0, PYTHONHOME=/home/takafumi/.virtualenvs/julia:/home/takafumi/.virtualenvs/julia
│ ENV[PYTHONPATH]=
│ ENV[PYTHONHOME]=
└ ENV[PYTHONEXECUTABLE]=
Test Summary: | Pass  Total
PyCall        |  443    443
Test Summary: | Pass  Total
pydef         |    8      8
Test Summary: | Pass  Total
callback      |    3      3
Test Summary: | Pass  Total
throwing show |    4      4
Test Summary: | Pass  Total
PyIterator    |   14     14
Test Summary: | Pass  Total
atexit        |    1      1
Test Summary: | Pass  Total
pycall!       |   16     16
Test Summary: | Pass  Total
PyBuffer      |   81     81
Running virtualenv with interpreter /usr/bin/python3.7
Using base prefix '/usr'
/usr/lib/python3.7/site-packages/virtualenv.py:1039: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
  import imp
New python executable in /tmp/tmpx0LyVH/ϵνιℓ/bin/python3.7
Also creating executable in /tmp/tmpx0LyVH/ϵνιℓ/bin/python
Installing setuptools, pip, wheel...done.
Test Summary:         | Pass  Total
virtualenv activation |    4      4
Test Summary:   | Pass  Total
venv activation |    4      4
[ Info: used 1897 out of 1897 precompile statements
Julia program file:
  "/home/takafumi/.julia/packages/PackageCompiler/oT98U/sysimg/precompile.jl"
Build directory:
  "/home/takafumi/.julia/packages/PackageCompiler/oT98U/sysimg"
┌ Info: activating new environment at ~/.julia/packages/PackageCompiler/oT98U/packages/Project.toml.
└ @ Pkg.API /buildworker/worker/package_linux64/build/usr/share/julia/stdlib/v1.1/Pkg/src/API.jl:519
  Updating registry at `~/.julia/registries/General`
  Updating git-repo `https://github.com/JuliaRegistries/General.git`
fatal: error thrown and no exception handler available.
ErrorException("Task cannot be serialized")
rec_backtrace at /buildworker/worker/package_linux64/build/src/stackwalk.c:94
record_backtrace at /buildworker/worker/package_linux64/build/src/task.c:217 [inlined]
jl_throw at /buildworker/worker/package_linux64/build/src/task.c:417
jl_error at /buildworker/worker/package_linux64/build/src/rtutils.c:41
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/staticdata.c:294
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/staticdata.c:286
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/julia.h:915 [inlined]
jl_serialize_module at /buildworker/worker/package_linux64/build/src/staticdata.c:230 [inlined]
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/staticdata.c:291
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/staticdata.c:252 [inlined]
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/staticdata.c:303
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/staticdata.c:252 [inlined]
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/staticdata.c:303
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/staticdata.c:286
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/staticdata.c:252 [inlined]
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/staticdata.c:303
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/staticdata.c:252 [inlined]
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/staticdata.c:303
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/staticdata.c:252 [inlined]
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/staticdata.c:303
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/staticdata.c:252 [inlined]
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/staticdata.c:303
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/staticdata.c:252 [inlined]
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/staticdata.c:303
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/staticdata.c:252 [inlined]
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/staticdata.c:303
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/julia.h:915 [inlined]
jl_serialize_module at /buildworker/worker/package_linux64/build/src/staticdata.c:230 [inlined]
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/staticdata.c:291
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/julia.h:915 [inlined]
jl_serialize_module at /buildworker/worker/package_linux64/build/src/staticdata.c:222 [inlined]
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/staticdata.c:291
jl_serialize_value_ at /buildworker/worker/package_linux64/build/src/staticdata.c:337 [inlined]
jl_save_system_image_to_stream at /buildworker/worker/package_linux64/build/src/staticdata.c:1273
jl_create_system_image at /buildworker/worker/package_linux64/build/src/staticdata.c:1378
jl_write_compiler_output at /buildworker/worker/package_linux64/build/src/precompile.c:76
jl_atexit_hook at /buildworker/worker/package_linux64/build/src/init.c:222
main at /buildworker/worker/package_linux64/build/ui/repl.c:218
__libc_start_main at /usr/lib/libc.so.6 (unknown line)
_start at /home/takafumi/opt/julia/julia-1.1.0/bin/julia (unknown line)
ERROR: failed process: Process(`/home/takafumi/opt/julia/julia-1.1.0/bin/julia --sysimage=/home/takafumi/.julia/packages/PackageCompiler/oT98U/sysimg/backup/native/sys.so --output-o=sys.a --track-allocation=none --code-coverage=none --history-file=yes --inline=yes --math-mode=ieee --compile=yes --track-allocation=none --sysimage-native-code=yes --sysimage=/home/takafumi/opt/julia/julia-1.1.0/lib/julia/sys.so --compiled-modules=yes --optimize=2 /home/takafumi/.julia/packages/PackageCompiler/oT98U/sysimg/run_julia_code.jl`, ProcessExited(1)) [1]
Stacktrace:
 [1] error(::String, ::Base.Process, ::String, ::Int64, ::String) at ./error.jl:42
 [2] pipeline_error at ./process.jl:785 [inlined]
 [3] #run#515(::Bool, ::Function, ::Cmd) at ./process.jl:726
 [4] run at ./process.jl:724 [inlined]
 [5] #run_julia#1 at /home/takafumi/.julia/packages/PackageCompiler/oT98U/src/compiler_flags.jl:225 [inlined]
 [6] #run_julia at ./none:0 [inlined]
 [7] (::getfield(PackageCompiler, Symbol("##13#14")){Base.Iterators.Pairs{Symbol,Any,NTuple{14,Symbol},NamedTuple{(:sysimage, :startup_file, :handle_signals, :sysimage_native_code, :compiled_modules, :depwarn, :warn_overwrite, :compile, :cpu_target, :optimize, :debug_level, :inline, :check_bounds, :math_mode),Tuple{String,Nothing,Nothing,Nothing,Nothing,Nothing,Nothing,Nothing,Nothing,Nothing,Nothing,Nothing,Nothing,Nothing}}},String})() at /home/takafumi/.julia/packages/PackageCompiler/oT98U/src/static_julia.jl:262
 [8] cd(::getfield(PackageCompiler, Symbol("##13#14")){Base.Iterators.Pairs{Symbol,Any,NTuple{14,Symbol},NamedTuple{(:sysimage, :startup_file, :handle_signals, :sysimage_native_code, :compiled_modules, :depwarn, :warn_overwrite, :compile, :cpu_target, :optimize, :debug_level, :inline, :check_bounds, :math_mode),Tuple{String,Nothing,Nothing,Nothing,Nothing,Nothing,Nothing,Nothing,Nothing,Nothing,Nothing,Nothing,Nothing,Nothing}}},String}, ::String) at ./file.jl:96
 [9] #build_object#12(::Base.Iterators.Pairs{Symbol,Any,NTuple{14,Symbol},NamedTuple{(:sysimage, :startup_file, :handle_signals, :sysimage_native_code, :compiled_modules, :depwarn, :warn_overwrite, :compile, :cpu_target, :optimize, :debug_level, :inline, :check_bounds, :math_mode),Tuple{String,Nothing,Nothing,Nothing,Nothing,Nothing,Nothing,Nothing,Nothing,Nothing,Nothing,Nothing,Nothing,Nothing}}}, ::Function, ::String, ::String, ::String, ::Bool) at /home/takafumi/.julia/packages/PackageCompiler/oT98U/src/static_julia.jl:261
 [10] #build_object at ./none:0 [inlined]
 [11] build_object(::String, ::String, ::String, ::Bool, ::String, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing) at /home/takafumi/.julia/packages/PackageCompiler/oT98U/src/static_julia.jl:240
 [12] #static_julia#5(::Nothing, ::Bool, ::Bool, ::String, ::String, ::Nothing, ::Bool, ::Bool, ::Bool, ::Bool, ::Bool, ::Bool, ::Bool, ::Bool, ::Nothing, ::Bool, ::Bool, ::String, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::typeof(static_julia), ::String) at /home/takafumi/.julia/packages/PackageCompiler/oT98U/src/static_julia.jl:161
 [13] #static_julia at ./none:0 [inlined]
 [14] #build_sysimg#29(::Bool, ::Bool, ::Bool, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::Nothing, ::typeof(PackageCompiler.build_sysimg), ::String, ::String) at /home/takafumi/.julia/packages/PackageCompiler/oT98U/src/api.jl:25
 [15] #build_sysimg at ./none:0 [inlined]
 [16] #compile_package#67(::Bool, ::Bool, ::Bool, ::Nothing, ::Bool, ::Function, ::Tuple{String,String}) at /home/takafumi/.julia/packages/PackageCompiler/oT98U/src/PackageCompiler.jl:130
 [17] #compile_package#64 at /home/takafumi/.julia/packages/PackageCompiler/oT98U/src/PackageCompiler.jl:116 [inlined]
 [18] compile_package(::String) at /home/takafumi/.julia/packages/PackageCompiler/oT98U/src/PackageCompiler.jl:88
 [19] top-level scope at none:0

[arnavs]

Can confirm that deving the package instead of adding made this error go away.

[JianghuiDu]

@arnavs Same here. Can confirm that dev makes this error go away on Windows 10 and Julia 1.1.0.

[arnavs]

I wonder why that is... I think there's two possible explanations:

• There are 12 commits in master that aren't in a tagged release, and some of them are necessary.

• The PackageCompiler directory (which also stores the sysimg, compiled environment TOML, etc.) needs to be a git repo for some reason.

[ronisbr]

I can also confirm that using dev in macOS fixed the problem.