[16:34] Hi all [16:34] people, I would like to run Ubuntu ARM 18.4 in a VM, what is the best choice? [16:34] !crosspost [16:34] Please don't ask the same question in multiple Ubuntu channels at the same time. Many helpers are in more than one channel and it's not fair to them or the other people seeking support. [16:36] blackflow: I need no GUI, so is just server, because this I post here too. Sorry [16:37] plm: so you want ARM on non-ARM harware? [16:37] qemu. in fact, always qemu. whether it uses kvm or not, is a different question. :) [16:37] blackflow: yes. [16:38] blackflow: actually I have the 14.4 running on qemu [16:38] blackflow: I dont know how that image was made. But I need a newer version of python [16:39] blackflow: I tryed a ppa, works installing a new python version (python3.6), but erros when installing python3.6-venv [16:39] blackflow: I tryied too to upgrade from 14.4 directaly to 18.4, but have errors [16:40] yeah go through 16.04 first [16:40] but be aware there's plenty of radically different stuff now, since 14.04 [16:41] as for your actual problem not sure I understand it. and personally I have zero exp. with ARM. Was jsut saying that for any virtualization solutions, same arch or cross arch, qemu is your tool of choice. [16:41] blackflow: ok. I will to try go to 16.4 and after to 18.4. Will try that now. [16:41] blackflow: all right, using qemu =D [16:44] blackflow: hey [16:44] blackflow: sorry. I did to you a wrong information. [16:44] I tried update 14.4 to 16.4 and I have error too, but... [16:45] blackflow: I tried again, without apt-get -f dist-upgrade, but just install the new python version (python3.5) and works [16:45] blackflow: 16.4 dont have python 3.6 [16:45] so I will to try chances sources.list to install 3.5 [16:46] and after installed I will change sources.list to use bionic, and try apt-get install python3.6 [16:47] plm: yeah that's totall not advisable. don't install packages from different releases. [16:47] *totally [16:47] blackflow: was the unique form to hace success [16:47] upagrade 14.4 to 16.4 I have error [16:47] what error? [16:48] blackflow: moment, I will try again and post here the error. [16:57] blackflow: the qemu is very slow, just wait more a moment =D [17:01] you can post it, someone might help, I have to step out for a while [17:05] blackflow: :( [17:05] blackflow: all right [17:05] blackflow: anyway, thanks === not_phunyguy is now known as phunyguy [17:32] blackflow: are yoy there? This is the error doing upgrade from 14.4 to 16.4: [17:32] /var/lib/dpkg/info/debconf.prerm: 12: /var/lib/dpkg/info/debconf.prerm: pyclean: not found [17:32] dpkg: warning: subprocess old pre-removal script returned error exit status 127 [17:32] dpkg: trying script from the new package instead ... [17:34] blackflow: complete log error: http://dpaste.com/0XQF5PZ [17:36] anyone more can help me with this upgrade error? [17:42] <_KaszpiR_> pycompile: not found [17:42] _KaszpiR_: yes, I see that. [17:42] <_KaszpiR_> https://stackoverflow.com/questions/30962402/dpkg-error-pycompile-not-found [17:43] _KaszpiR_: I did *exactally* that that thared recommend, and not works [17:44] _KaszpiR_: sudo apt-get -f install; sudo dpkg --configure -a; sudo apt install -f --reinstall python3-minimal [17:44] _KaszpiR_: I tried too that alternative above there [17:44] plm: see if there is a file in the system already with "dpkg -S pyclean" and "dpkg -S pycompile" [17:46] TJ-: all right. Please, give me a momento, I crating that scenario again. [17:47] plm: it's possible the files are there but they have a shebang line that refers to an executable that is missing (such as the python 2.x vs 3.x issue) [17:50] TJ-: all right. If necessary, and better to upgrade from 14.4 to 16.4, I can remove any packages, and after upgraded to 16.4, install again. Anyway, please, wait, I creating that scenario again to do that commands that yuy paste me. [18:21] TJ-: more some minutes =D [18:26] TJ-: done [18:27] TJ-: root@mintboxa:~# dpkg -S pyclean [18:27] dh-python: /usr/share/debhelper/autoscripts/prerm-pypyclean [18:27] TJ-: python-minimal: /usr/bin/pycompile [18:27] python: /usr/share/debhelper/autoscripts/postinst-pycompile [18:28] TJ-: there are more lines. Complete log is here: http://dpaste.com/174STZ6 [18:28] TJ-: and now, what I need to do? [18:30] plm: what does "head /usr/bin/pyclean" report? [18:30] plm: first line only - the shebang [18:31] TJ-: http://dpaste.com/37MF6BP [18:31] TJ-: root@mintboxa:~# head /usr/bin/pyclean [18:31] #! /usr/bin/python [18:31] # -*- coding: UTF-8 -*- vim: et ts=4 sw=4 [18:34] TJ-: I need to change that "#! /usr/bin/python"? [18:36] plm: no, I'm trying to check on what to expect. What does "readlink -e /usr/bin/python" report? [18:38] TJ-: root@mintboxa:~# readlink -e /usr/bin/python [18:38] root@mintboxa:~# [18:38] plm: also check for "head /usr/bin/pycompile" and use readlink -e on what it shows, too. Ensure both point to executables [18:38] root@mintboxa:~# head /usr/bin/pycompile [18:38] #! /usr/bin/python [18:38] # -*- coding: utf-8 -*- vim: et ts=4 sw=4 [18:38] plm: what does "file /usr/bin/python" report ? [18:38] root@mintboxa:~# readlink -e /usr/bin/pycompile [18:38] /usr/bin/pycompile [18:38] root@mintboxa:~# [18:39] root@mintboxa:~# file /usr/bin/python [18:39] /usr/bin/python: ERROR: cannot open `/usr/bin/python' (No such file or directory) [18:39] root@mintboxa:~# [18:39] plm: there is your problem [18:39] plm: what does "ls -l /usr/bin/python*" report? It might just be a missing symlink [18:39] TJ-: there is no python. [18:40] plm: there should be! [18:40] TJ-: http://dpaste.com/2JFK0GH [18:40] TJ-: many lines, I paste ^ [18:41] plm: so there is both python2.7 and python3.4 installed but nothing is symlinking from /usr/bin/python. Let's fix that manually with "sudo ln -s python2.7 /usr/bin/python" [18:41] plm: now your upgrade problems should be solved [18:42] TJ-: =D Trying again apt-get -f dist-upgrade [18:45] TJ-: debconf pass =D upgrading... [18:53] TJ-: still upgrading. Is possible to give more power to qemu? Qemu is very slow :( [18:57] plm: shouldn't be if you're using KVM hardware accelearion [18:58] plm: unless it needs more cores or more RAM of course [18:59] TJ-: this is my qemu start.sh http://dpaste.com/3GRCB9Z [18:59] TJ-: There that ai put more RAM/core dedicated to qemu, or qemu get automatically from my system. My ssytem has 12GB RAM and many cores [19:02] I think is that "-m 1024" that is 1024MB, right? [19:03] plm: yes [19:04] "-smp - Specify the number of cores the guest is permitted to use. The number can be higher than the available cores on the host system" [19:04] I will to try use after upgrade, the "-smp 4" =D [19:04] plm: it's an ARM cortex, so can't expect it to be fast. But, is it I/O bound to a slow device such as SDcard? [19:05] TJ-: no, is in MY SATA HD, very fast [19:06] plm: ok, what's the device ? [19:06] TJ-: I think is RAM just 1024 the problem, and maybe without -smp param, it get just one core. [19:06] TJ-: Disk /dev/sda: 931,5 GiB, 1000204886016 bytes, 1953525168 sectors [19:07] TJ-: Model Family: Western Digital Blue [19:07] Device Model: WDC WD10EZEX-00BN5A0 [19:07] plm: it's not SATA, the VM says root=/dev/mmcblk0p1 -- mmc is likely an SD card [19:08] TJ-: I dont know why that "root=/dev/mmcblk0p1" I have just one disc in my PC [19:08] plm: is it mapping the boot files inside the VM guest as an SD card then? [19:09] plm: Ah, further on I see "-sd rootfs.img" [19:10] plm: you can use 'iotop' on the host to see if there's a bottleneck there. [19:11] 13391 be/4 root 3.47 K/s 114.65 K/s 0.00 % 1.00 % qemu-system-arm -M realview-pb-a8 -cpu cortex-a8 -m 1024 -ke~.1.1:255.0.0.0:armqemu -sd rootfs.img -initrd initrd.img -usb [19:11] TJ-: ^ [19:13] plm: maybe it is doing full emulation - not providing any hardware support like KVM does on x86 ? [19:13] pi@deskdev-pi:~$ cat /proc/cpuinfo | grep -i kvm [19:13] pi@deskdev-pi:~$ [19:13] TJ-: ^ [19:17] plm: there you go then; I know there is kvm support for HYP on ARM - not sure if it is baked in though or you need external (self-built) binaries for that [19:19] plm: i see 'kvmtool' is in the Ubuntu archives, so you could install that and use "lkvm" to run the guests [19:21] plm: you might also check the kernel was built with CONFIG_KVM [19:21] TJ-: in the host: root@deskdev-pi:~# apt-cache search kvmtool [19:21] kvmtool - Native Linux KVM TOOL [19:21] just install kvmtool in the host? [19:21] and how I call "lkvm" for the qemu guests? [19:21] plm: well not 'just' - that's the userspace handler. You need to ensure the CPU/kernel support HYP mode and can load the kvm module [19:22] "CONFIG_KVM" are there easy waty (cat) to check? [19:22] plm: you'd need to install kvmtool and "man lkvm" [19:22] ok [19:22] plm: "grep KVM /boot/config-$(uname -r)" usually [19:23] CONFIG_KVM_GUEST=y [19:23] many lines, will put on dpaste [19:23] TJ-: http://dpaste.com/0Z4WB3H [19:25] plm: the host is ARM yes? [19:25] TJ-: no, is a x86, intel [19:26] model name : Intel(R) Core(TM) i5-3330 CPU @ 3.00GHz [19:26] Oh! I thought you said it was an ARM coretex [19:26] 3 cores [19:26] sorry if I say wrong [19:26] the guest (qemu) are running the arm [19:26] so everything is as expected. you cannot get hardware acceleration (KVM) support for another foreign architecture like ARM [19:27] ohh [19:27] so qemu is running in software emulation mode, which is why it is slow [19:27] mut if my qemu was runing a x86, I can get acceleration, right? [19:27] but maybe confifgure more RAM and -smp 3 help =D [19:28] when you run a guest of the same architecture as the host, qemu can use KVM to allow the host CPU to safely execute most instructions with 0 delay. With a different arch, the host has to simulate every machine instruction [19:28] TJ-: Understood. [19:29] TJ-: well, I think is finishing the upgrade to 16.4. after I will upgrade to 18.4 =D [19:29] TJ-: as python problem was fixed, to 18.4 will have no problems, right? [19:30] That's one reason I like the PC Engines APU series - based on x86 AMD CPUs - and designed to be routers but can support much more. I've got SSD in one, as well as SD-card, with 4 gigabit ports, and 2 spare mini-pcie slots [19:30] plm: I'd hope so :) [19:42] TJ-: please, what model did you bought? I would like to check price on the internet =D [19:42] TJ-: finished upgrade. doing a reboot to check if boot ok [19:47] TJ-: [19:48] TJ-: error after reboot mounting filesystem [19:49] TJ-: I will paste de image becouse is not possible to copy from qemu window [19:50] TJ-: https://paste.pics/3V0PK [19:50] TJ-: are you there [19:50] ? [19:57] TJ-: ping =D [20:05] plm: sorry, was at dinner. APU2C4 https://pcengines.ch/apu2c4.htm [20:06] TJ-: hey =D [20:07] plm: with this case https://pcengines.ch/case1d2bluu.htm [20:07] I will check later =D Did you see my image with erros? [20:07] *picture [20:08] TJ-: I just did reboot after upgraded [20:15] plm: was that when running the guest with qemu? [20:18] TJ-: yes [20:18] TJ-: that picture is just of guest. I have the qemu running on host x86 linux [20:18] plm: the only causes of those messages is in containers, not virtual machines [20:18] TJ-: look a new picure [20:19] plm ^^^ that I could find, so I'm not sure what is going on there. [20:19] TJ-: https://i.paste.pics/3V0TM.png [20:20] plm: "failed to mount tmpfs at/sys/fs/cgroup" suggest sysfs isn't mounted at /sys/ [20:21] plm: so I suspect something wrong with how systemd is starting up, or on some config it is relying on [20:21] TJ-: but before upgrade boot ok [20:21] was the upgrade make that problem, right? [20:22] maybe to do something before reboot, after upgraded? [20:22] plm: I'd doubt it - this shouldall happen automatically [20:22] shit :( [20:23] that was my hope =D [20:23] Are there something to do to change that, maybe before booting? [20:38] plm: not sure what is going on. systemd (the init daemon that runs as PID 1) has internal logic to mount sysfs, so maybe that is there but it fails to create cgroup part - there isn't enough info. Can you boot it with "systemd.log_level=debug" on the guest kernel's command line ? [20:41] TJ-: yes [20:42] TJ-: qemu-system-arm: -usb: Could not open 'systemd.log_level=debug': No such file or directory [20:43] TJ-: I did: [20:43] plm: you might want to add a serial console to the guest so you can capture the text output, rather than trying to screenshot what may be a LOT of output [20:43] function run_qemu () [20:43] { [20:43] qemu-system-arm -M realview-pb-a8 -cpu cortex-a8 -m 1024 -kernel uImage.realview-vm.kernel -net nic -net tap,ifname=tap0 -append "root=/dev/mmcblk0p1 rootwait rw ip=${QEMU_IP}:${IP}:${IP}:255.0.0.0:armqemu" -sd rootfs.img -initrd initrd.img -usb systemd.log_level=debug [20:43] } [20:43] plm: !!!! silly [20:43] plm: you have to add inside the quotes for the -append "..." !! [20:43] ohh [20:43] right [20:44] TJ-: qemu-system-arm -M realview-pb-a8 -cpu cortex-a8 -m 1024 -kernel uImage.realview-vm.kernel -net nic -net tap,ifname=tap0 -append "root=/dev/mmcblk0p1 rootwait rw ip=${QEMU_IP}:${IP}:${IP}:255.0.0.0:armqemu systemd.log_level=debug" -sd rootfs.img -initrd initrd.img -usb [20:45] TJ-: I tried to run with that conf above ^, but not show more error than last time [20:46] plm: so it is failing VERY early then [20:47] plm: :( I was take a look on this: https://github.com/nongiach/arm_now] [20:47] https://github.com/nongiach/arm_now [20:47] TJ-: what do you think ^? [20:48] ubuntu 18.4 on that ^ [20:56] arm_now works here, but is not possible install python, and other apps :( [20:56] plm: are you doing exploit testing? It doesn't seem ideal for much else [20:56] TJ-: you are rith, I need a full system [20:56] TJ-: look this : [20:57] TJ-: https://gist.github.com/Liryna/10710751 [20:57] That ^ I think will works right? I see arm_now in this url, but as comment, o the bottom of page [20:58] plm: you could boot the guest as far as the end of the initial ramdisk init script, before it calls the systemd init on the real rootfs - that should give you a busybox shell to investigate from. in that -append="..." add "break=init" [21:00] TJ-: doing now, moment [21:01] TJ-: qemu-system-arm -M realview-pb-a8 -cpu cortex-a8 -m 1024 -kernel uImage.realview-vm.kernel -net nic -net tap,ifname=tap0 -append "root=/dev/mmcblk0p1 rootwait rw ip=${QEMU_IP}:${IP}:${IP}:255.0.0.0:armqemu systemd.log_level=debug break=init" -sd rootfs.img -initrd initrd.img -usb [21:02] TJ-: pi@deskdev-pi:~/tmp/tmp/vm-cortex_a8_omap3$ sudo ./qemu_start.sh [21:02] Configuring NAT [21:02] TUNSETIFF: Device or resource busy [21:02] qemu-system-arm: -net tap,ifname=tap0: could not configure /dev/net/tun (tap0): Device or resource busy [21:03] TJ-: sorry [21:03] two qemu session [21:03] plm: I was about to say that :) [21:04] TJ-: [21:04] works [21:04] Busysbox line [21:04] TJ-: (iniramfs) [21:05] plm: right, so "mount" - is there a sysfs at /sys ? [21:06] https://paste.pics/3V0YL [21:06] no [21:07] "mount" show just "mount: no /proc/mounts" [21:07] TJ-: ^ [21:07] plm: hmmm [21:07] plm: "cat /proc/mounts" ? [21:08] TJ-: https://paste.pics/3V0YW [21:09] plm: so it's not pivoted yet.. so we need to track down where the rootfs is right now. do "ls -la" and show me [21:10] TJ-: https://paste.pics/3V101 [21:11] plm: ahhh, under /root/ I think. Show me "ls -la /root/" please [21:11] TJ-: https://paste.pics/3V108 [21:12] plm: aha! there's the rootfs! OK "cat /root/proc/mounts" [21:13] TJ-: https://paste.pics/3V10G [21:15] plm: we're making progress, there's the sysfs. lets see what is in it "ls -l /root/sys/fs/" [21:17] TJ-: https://paste.pics/3V10T [21:18] plm: so the node is there but nothing else in it yet. So it must be systemd's job to mount the cgroup fs there, and then add its other file-systems. [21:18] plm: I'm not sure why it isn't doing that then - the initrd is preparing the ground correctly [21:19] hmm [21:19] plm: try getting the init to continue to boot to systemd with "exit" [21:19] ok [21:19] TJ-: https://paste.pics/3V112 [21:20] plm: I wonder if this "autofs4" is the root cause? [21:20] I dont know :( [21:21] plm: restart the guest - let it drop to the shell again, then try "modprobe autofs4" [21:21] ok [21:21] plm: I suspect that will fail with the same error and so we'll need to search the file-system for it. I'm wondering if it is missing [21:21] TJ-: done, and now? [21:22] "modprobe autofs4" just pass to next line [21:22] that suggests it loaded! [21:22] try "lsmod | grep autofs" [21:22] "exit"? [21:22] ok [21:22] plm: that ought to show the module is loaded [21:22] dont have lsmod [21:22] lsmod: not found [21:22] "lsmod: not found" [21:22] oh phooey of course! [21:23] because we're not in the real rootfs yet [21:23] TJ-: "/bin/sh: lsmod: not found" [21:23] ok [21:23] plm: this may work: "/root/sbin/lsmod | grep autofs" [21:24] TJ-: https://paste.pics/3V11T [21:28] plm: lol - so we got the command to work but it expects /proc/modules, and we're at /root/proc/modules! let's do it manually: "grep autofs4 /root/proc/modules" [21:29] TJ-: "grep autofs4 /root/proc/modules" just pass to next line [21:29] plm: so no match then. [21:30] plm: ok, lets try "find /root/lib/modules -name 'autofs4.ko' " [21:30] "/root/lib/modules" do not exists [21:30] "/root/lib/modprobe.d" exists [21:31] plm: eeek, that'd cause the problems alright! [21:31] hmmm [21:31] plm: show me "ls /root/lib/modules/" [21:31] :) [21:31] plm: all the modules for each kernel version should be under that path [21:32] plm: which suggests the dist-upgrade didn't complete correctly [21:32] "ls /root/lib/modules/" show "not file or directory" [21:32] TJ-: I did "apt-get -f dist-ugprade" [21:32] plm: now I'm really concerned; that is very broken [21:33] TJ-: after that no error show for me [21:33] plm how about "find /root/lib/" [21:33] plm: I want to see what IS found [21:33] "find /root/lib/" show many many lines, need to paste? [21:33] plm: I think you need to fix this using qemu-static and a chroot, not a virtual machine. [21:34] plm: screenshot what you can see, that'll give me an idea [21:34] TJ-: "find /root/lib/" show more than a page, I cant copy more than a page, becouse past in qemu window [21:34] ok [21:34] plm: show me the last page [21:34] plm: actually no, hang on [21:34] plm: show me this instead: "find /root/lib -type d" [21:34] TJ-: https://paste.pics/3V136 [21:35] TJ-: https://paste.pics/3V139 "find /root/lib -type d" [21:36] TJ-: https://paste.pics/3V13G "find /root/lib -type d" - page 1 [21:36] plm: can you remind me of the content of the script on the host that starts qemu? [21:37] TJ-: qemu-system-arm -M realview-pb-a8 -cpu cortex-a8 -m 1024 -kernel uImage.realview-vm.kernel -net nic -net tap,ifname=tap0 -append "root=/dev/mmcblk0p1 rootwait rw ip=${QEMU_IP}:${IP}:${IP}:255.0.0.0:armqemu systemd.log_level=debug break=init" -sd rootfs.img -initrd initrd.img -usb [21:37] TJ-: function run_qemu () [21:37] { [21:37] qemu-system-arm -M realview-pb-a8 -cpu cortex-a8 -m 1024 -kernel uImage.realview-vm.kernel -net nic -net tap,ifname=tap0 -append "root=/dev/mmcblk0p1 rootwait rw ip=${QEMU_IP}:${IP}:${IP}:255.0.0.0:armqemu systemd.log_level=debug break=init" -sd rootfs.img -initrd initrd.img -usb [21:37] plm: the problem seems to be there are no kernel (modules) installed, which means the linux-image-$VERSION-generic packages are missing [21:37] hmm [21:37] Is possible to copy from original qemu image? [21:37] plm: ahhh, there is the problem! you're loading the kernel image external to the rootfs, so you've not installed the matching kernel modules [21:38] plm: you need the modules that were built with that kernel ("uImage.realview-vm.kernel") so the versions match [21:38] TJ-: http://dpaste.com/0MCCHK1 [21:38] plm: it's not a 'true' virtual machine [21:38] this is complete start.sh qemu ^ [21:39] hmm [21:39] plm: as in you're providing the kernel and initrd so the OS in the rootfs doesn't have them, and so it likely doesn't even have access to the correct packages that contain the modules [21:39] TJ-: but how before upgrade that works? [21:40] plm: when the system was 14.04 this didn't matter because the init system was upstart and it didn't try to insmod any kernel modules. But systemd expects to be able to [21:40] TJ-: pi@deskdev-pi:~/tmp/tmp/vm-cortex_a8_omap3$ ls [21:40] initrd.img qemu_start.sh rootfs.img uImage.realview-vm.kernel [21:40] pi@deskdev-pi:~/tmp/tmp/vm-cortex_a8_omap3$ [21:41] understood [21:41] plm: the OS inside the rootfs has no control over its boot device, its kernel, or its initial ramdisk [21:41] what we can to do to fix that? [21:42] TJ-: how is possible to fix that? [21:42] plm: usually the OS installs the linux-image-$VERSION-generic (contains kernel + modules) and linux-headers-$VERSION-generic (contains files required to build other modules for that kernel) and the modules are stored at /lib/modules/$VERSION/ - but your rootfs is mssing all those [21:43] TJ-: are there something to do in qemu config, like as, I will start again 14.4 and upgrade again to 16.4 [21:43] plm: you need to find the built modules matching that kernel you are using, then install them into the rootfs at /lib/modules/$VERSION/ and then run "depmod --all" to fill the module cache [21:44] plm: with the external kernel/initrd there's not a lot you can do - they are not Ubuntu kernels [21:44] TJ-: now, or before upgrade to 16.4? [21:44] hmm [21:44] TJ-: so, are there no solution for this case? [21:44] plm: is there not an Ubuntu kernel image that you can use? [21:44] plm: I can use any kernel. [21:45] but that is what I have [21:45] plm: where did you get that uImage.realview-vm.kernel ? [21:46] plm: because that's where you would need to get the matching modules / headers [21:46] plm: I dont know, this are here many years, i think :( [21:46] TJ-: I dont know, this are here many years, i think :( [21:48] plm: is that guest image every run on real hardware, or always as a virtual machine? [21:49] hmm [21:49] TJ-: always ion VM [21:50] TJ-: just after i complete my python app, I generate a package in this arm VM and after send to run in a real armv7 [21:50] plm: ok, so you could change things then. I'd suggest installing qemu-user-static and binfmt-support on the host, loop-mounting that rootfs and using qemu-user-static to chroot into it [21:51] all right, doing now [21:52] that package contains "/usr/bin/qemu-arm-static" which you should be able to call on (automatically if you install binfmt-support) [21:52] TJ-: binfmt-support already installed and now I installed the "qemu-user-static" [21:52] TJ-: and now? [21:52] "loop-mounting that rootfs and using qemu-user-static to chroot into it" how to do that? [21:52] plm: hmm, it is a while since I had to do this, can't recall all the steps now [21:53] TJ-: "mount -o loop rootfs.img /mnt/rootfs" [21:53] ? [21:53] mount -o loop rootfs.img /mnt/rootfs [21:53] https://stackoverflow.com/questions/75862/mount-rootfs-on-loopback [21:53] plm: "sudo mkdir /target" then "sudo chroot /target /bin/bash" - if that works you'll be running the *ARM* binaries [21:53] ok [21:53] plm: oh yeah, mount loop first!!! [21:54] TJ-: I will stop that lat vm busibox, ok? [21:54] plm: "sudo mkdir /target", "sudo mount -o loop rootfs.img /target", then "sudo chroot /target /bin/bash" - if that works you'll be running the *ARM* binaries [21:54] plm: tes [21:54] yes [21:54] ok [21:55] pi@deskdev-pi:~/tmp/tmp/vm-cortex_a8_omap3$ sudo mount -o loop rootfs.img /target [21:55] mount: wrong fs type, bad option, bad superblock on /dev/loop0, [21:55] missing codepage or helper program, or other error [21:55] TJ-: ^ [21:55] oh [21:56] plm: hmm, it is ext4 isn't it? [21:56] plm: maybe it's due to the OMAP - is it big-endian or little-endian? [21:56] TJ-: good question [21:56] :) [21:56] I think is little endiar [21:57] cortex a8 (armv7) [21:57] plm: "file rootfs.img" [21:57] pi@deskdev-pi:~/tmp/tmp/vm-cortex_a8_omap3$ file rootfs.img [21:57] rootfs.img: DOS/MBR boot sector; partition 1 : ID=0x83, active, start-CHS (0x0,32,33), end-CHS (0x17e,113,51), startsector 2048, 6141952 sectors [21:57] TJ-: ^ [21:57] plm: hmmm, not much help was it! [21:58] plm: it looks like a raw disk image though, mentioning partitions, so you need to do "sudo losetup --partscan /dev/loop0 rootfs.img" [21:58] plm: then you should have some /dev/loop0pX nodes, probablly just loop0p1 ? [21:59] pi@deskdev-pi:~/tmp/tmp/vm-cortex_a8_omap3$ sudo losetup --partscan /dev/loop0 rootfs.img [21:59] pi@deskdev-pi:~/tmp/tmp/vm-cortex_a8_omap3$ [21:59] pi@deskdev-pi:~/tmp/tmp/vm-cortex_a8_omap3$ ls /dev/loop0p1 [21:59] /dev/loop0p1 [21:59] Yes [21:59] plm: yay! so then "mount /dev/loop0p1 /target" [21:59] with 'sudo' of course [22:00] done [22:00] =D [22:00] mounted [22:00] TJ-: ^ [22:02] plm: OK, acid test now. "sudo chroot /target /bin/bash" - if this works are you get a root shell (# not $ prompt) then it worked [22:02] s/are/and/ [22:02] pi@deskdev-pi:~$ sudo chroot /target /bin/bash [22:02] chroot: failed to run command ‘/bin/bash’: No such file or directory [22:03] TJ-: ^ [22:03] pi@deskdev-pi:~$ sudo chroot /target [22:03] chroot: failed to run command ‘/bin/bash’: No such file or directory [22:03] plm: OK, check if one exists first: "ls /target/bin/bash" [22:03] pi@deskdev-pi:~$ ls /target/bin/bash [22:03] /target/bin/bash [22:03] TJ-: yes, exists [22:03] plm: now we'll check it is ARM format: "file /target/bin/bash" [22:04] TJ-: pi@deskdev-pi:~$ file /target/bin/bash [22:04] /target/bin/bash: ELF 32-bit LSB executable, ARM, EABI5 version 1 (SYSV), dynamically linked, interpreter /lib/ld-linux-armhf.so.3, for GNU/Linux 2.6.32, BuildID[sha1]=3b053d97ab6f0b39d06f6a7dc204f5398b29cb68, stripped [22:05] plm: good, so the problem here then must be qemu-arm-static not being called [22:07] TJ-: "qemu-user-static" was what you say to me install [22:07] "qemu-arm-static" do not exists [22:07] plm: "pastebinit <( update-binfmts --display | grep -C 6 qemu-arm )" [22:08]