K8s: Unable to mount volumes for pod Unicorn Meta Zoo #1: Why another podcast? ...

What is the least dense liquid under normal conditions?

Will I lose my paid in full property

What if Force was not Mass times Acceleration?

Implementing 3DES algorithm in Java: is my code secure?

Co-worker works way more than he should

Map material from china not allowed to leave the country

Why did Israel vote against lifting the American embargo on Cuba?

Putting Ant-Man on house arrest

Can you stand up from being prone using Skirmisher outside of your turn?

What was Apollo 13's "Little Jolt" after MECO?

c++ diamond problem - How to call base method only once

Israeli soda type drink

What is /etc/mtab in Linux?

Visa-free travel to the US using refugee travel document from Spain?

All ASCII characters with a given bit count

Arriving in Atlanta after US Preclearance in Dublin. Will I go through TSA security in Atlanta to transfer to a connecting flight?

Second order approximation of the loss function (Deep learning book, 7.33)

What is a 'Key' in computer science?

What is the ongoing value of the Kanban board to the developers as opposed to management

How to avoid introduction cliches

"Whatever a Russian does, they end up making the Kalashnikov gun"? Are there any similar proverbs in English?

A strange hotel

Book with legacy programming code on a space ship that the main character hacks to escape

Does Feeblemind produce an ongoing magical effect that can be dispelled?



K8s: Unable to mount volumes for pod



Unicorn Meta Zoo #1: Why another podcast?
Announcing the arrival of Valued Associate #679: Cesar ManaraSystemd service start errorHow do I figure out why systemctl service “systemd-modules-load” fails?Unable to mount external drive or sshfsUnable to move MySQL data to external driveMasked/Hidden PartitionWhat is causing the failure in the msodbcsql instalation and how can I solve it?Error bluetooth with systemtclParrot Security OS - The MATE Panel V1,20.5 — Menu Bar _ a custom menu bar (EDIT MENUS ISSUE)Kubernetes 110 pod per node limitkubeadm init is not initing the cluster





.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty{ height:90px;width:728px;box-sizing:border-box;
}







0















Unable to mount volumes for pod "pod-using-nfs_hyperledger(8c3b3949-6673-11e9-99ae-525400dce7c4)": timeout expired waiting for volumes to attach or mount for pod "hyperledger"/"pod-using-nfs". list of unmounted volumes=[nfs-volume]. list of unattached volumes=[nfs-volume default-token-zf8wr]


I get this error when trying to mount pods to volumes on my local setup.
Here is "kubectl describe pod pod-using-nfs -n hyperledger"



Name:         pod-using-nfs
Namespace: hyperledger
Node: nfs-virt1/11.0.0.74
Start Time: Wed, 24 Apr 2019 11:30:07 +0200
Labels: <none>
Annotations: <none>
Status: Pending
IP:
Containers:
app:
Container ID:
Image: alpine
Image ID:
Port: <none>
Host Port: <none>
Command:
/bin/sh
Args:
-c
while true; do date >> /var/nfs/dates.txt; sleep 5; done
State: Waiting
Reason: ContainerCreating
Ready: False
Restart Count: 0
Environment: <none>
Mounts:
/var/nfs from nfs-volume (rw)
/var/run/secrets/kubernetes.io/serviceaccount from default-token-zf8wr (ro)
Conditions:
Type Status
Initialized True
Ready False
ContainersReady False
PodScheduled True
Volumes:
nfs-volume:
Type: NFS (an NFS mount that lasts the lifetime of a pod)
Server: 10.152.183.136
Path: /
ReadOnly: false
default-token-zf8wr:
Type: Secret (a volume populated by a Secret)
SecretName: default-token-zf8wr
Optional: false
QoS Class: BestEffort
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute for 300s
node.kubernetes.io/unreachable:NoExecute for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Scheduled 29m default-scheduler Successfully assigned hyperledger/pod-using-nfs to nfs-virt1
Warning FailedMount 27m kubelet, nfs-virt1 MountVolume.SetUp failed for volume "nfs-volume" : mount failed: exit status 32
Mounting command: systemd-run
Mounting arguments: --description=Kubernetes transient mount for /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume --scope -- mount -t nfs 10.152.183.136:/ /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume
Output: Running scope as unit: run-r3aa4f0d9f3474be0a05dd6f7cfb562f9.scope
mount.nfs: Connection timed out
Warning FailedMount 25m kubelet, nfs-virt1 MountVolume.SetUp failed for volume "nfs-volume" : mount failed: exit status 32
Mounting command: systemd-run
Mounting arguments: --description=Kubernetes transient mount for /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume --scope -- mount -t nfs 10.152.183.136:/ /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume
Output: Running scope as unit: run-r38b21cbab5394dea8d9a9519e6246af1.scope
mount.nfs: Connection timed out
Warning FailedMount 23m kubelet, nfs-virt1 MountVolume.SetUp failed for volume "nfs-volume" : mount failed: exit status 32
Mounting command: systemd-run
Mounting arguments: --description=Kubernetes transient mount for /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume --scope -- mount -t nfs 10.152.183.136:/ /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume
Output: Running scope as unit: run-r38be2dac85d9479eb9246530b5344877.scope
mount.nfs: Connection timed out
Warning FailedMount 21m kubelet, nfs-virt1 MountVolume.SetUp failed for volume "nfs-volume" : mount failed: exit status 32
Mounting command: systemd-run
Mounting arguments: --description=Kubernetes transient mount for /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume --scope -- mount -t nfs 10.152.183.136:/ /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume
Output: Running scope as unit: run-re4f97ef6cf234625a6de6055f6848e24.scope
mount.nfs: Connection timed out
Warning FailedMount 19m kubelet, nfs-virt1 MountVolume.SetUp failed for volume "nfs-volume" : mount failed: exit status 32
Mounting command: systemd-run
Mounting arguments: --description=Kubernetes transient mount for /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume --scope -- mount -t nfs 10.152.183.136:/ /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume
Output: Running scope as unit: run-r338bc5401ea14fbcb2dc6c55aac518c3.scope
mount.nfs: Connection timed out
Warning FailedMount 17m kubelet, nfs-virt1 MountVolume.SetUp failed for volume "nfs-volume" : mount failed: exit status 32
Mounting command: systemd-run
Mounting arguments: --description=Kubernetes transient mount for /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume --scope -- mount -t nfs 10.152.183.136:/ /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume
Output: Running scope as unit: run-r26be7bb2a8c54985836e9825793dc960.scope
mount.nfs: Connection timed out
Warning FailedMount 14m kubelet, nfs-virt1 MountVolume.SetUp failed for volume "nfs-volume" : mount failed: exit status 32
Mounting command: systemd-run
Mounting arguments: --description=Kubernetes transient mount for /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume --scope -- mount -t nfs 10.152.183.136:/ /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume
Output: Running scope as unit: run-red5e0a72dcad4dc9a0d3d97b3f398795.scope
mount.nfs: Connection timed out
Warning FailedMount 12m kubelet, nfs-virt1 MountVolume.SetUp failed for volume "nfs-volume" : mount failed: exit status 32
Mounting command: systemd-run
Mounting arguments: --description=Kubernetes transient mount for /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume --scope -- mount -t nfs 10.152.183.136:/ /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume
Output: Running scope as unit: run-r228748a1144b41888e84bad1be12388d.scope
mount.nfs: Connection timed out
Warning FailedMount 50s (x3 over 9m5s) kubelet, nfs-virt1 (combined from similar events): MountVolume.SetUp failed for volume "nfs-volume" : mount failed: exit status 32
Mounting command: systemd-run
Mounting arguments: --description=Kubernetes transient mount for /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume --scope -- mount -t nfs 10.152.183.136:/ /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume
Output: Running scope as unit: run-r2cd27edee6c24a47a63cd32439f2e4a4.scope
mount.nfs: Connection timed out
Warning FailedMount 42s (x13 over 27m) kubelet, nfs-virt1 Unable to mount volumes for pod "pod-using-nfs_hyperledger(8c3b3949-6673-11e9-99ae-525400dce7c4)": timeout expired waiting for volumes to attach or mount for pod "hyperledger"/"pod-using-nfs". list of unmounted volumes=[nfs-volume]. list of unattached volumes=[nfs-volume default-token-zf8wr]


this is also true for a few other pods using another volume.
Am I missing something essential?










share|improve this question







New contributor




Yuven is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
















  • 1





    Did you check if the NFS filesystem is actually available on the K8S node?

    – xenoid
    11 hours ago











  • @xenoid, do you have any good way to check that? I followed a guide that set up the nfs, so I thought it might make it available too

    – Yuven
    10 hours ago













  • Log in on the worker node and try to mount it by hand?

    – xenoid
    10 hours ago


















0















Unable to mount volumes for pod "pod-using-nfs_hyperledger(8c3b3949-6673-11e9-99ae-525400dce7c4)": timeout expired waiting for volumes to attach or mount for pod "hyperledger"/"pod-using-nfs". list of unmounted volumes=[nfs-volume]. list of unattached volumes=[nfs-volume default-token-zf8wr]


I get this error when trying to mount pods to volumes on my local setup.
Here is "kubectl describe pod pod-using-nfs -n hyperledger"



Name:         pod-using-nfs
Namespace: hyperledger
Node: nfs-virt1/11.0.0.74
Start Time: Wed, 24 Apr 2019 11:30:07 +0200
Labels: <none>
Annotations: <none>
Status: Pending
IP:
Containers:
app:
Container ID:
Image: alpine
Image ID:
Port: <none>
Host Port: <none>
Command:
/bin/sh
Args:
-c
while true; do date >> /var/nfs/dates.txt; sleep 5; done
State: Waiting
Reason: ContainerCreating
Ready: False
Restart Count: 0
Environment: <none>
Mounts:
/var/nfs from nfs-volume (rw)
/var/run/secrets/kubernetes.io/serviceaccount from default-token-zf8wr (ro)
Conditions:
Type Status
Initialized True
Ready False
ContainersReady False
PodScheduled True
Volumes:
nfs-volume:
Type: NFS (an NFS mount that lasts the lifetime of a pod)
Server: 10.152.183.136
Path: /
ReadOnly: false
default-token-zf8wr:
Type: Secret (a volume populated by a Secret)
SecretName: default-token-zf8wr
Optional: false
QoS Class: BestEffort
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute for 300s
node.kubernetes.io/unreachable:NoExecute for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Scheduled 29m default-scheduler Successfully assigned hyperledger/pod-using-nfs to nfs-virt1
Warning FailedMount 27m kubelet, nfs-virt1 MountVolume.SetUp failed for volume "nfs-volume" : mount failed: exit status 32
Mounting command: systemd-run
Mounting arguments: --description=Kubernetes transient mount for /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume --scope -- mount -t nfs 10.152.183.136:/ /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume
Output: Running scope as unit: run-r3aa4f0d9f3474be0a05dd6f7cfb562f9.scope
mount.nfs: Connection timed out
Warning FailedMount 25m kubelet, nfs-virt1 MountVolume.SetUp failed for volume "nfs-volume" : mount failed: exit status 32
Mounting command: systemd-run
Mounting arguments: --description=Kubernetes transient mount for /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume --scope -- mount -t nfs 10.152.183.136:/ /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume
Output: Running scope as unit: run-r38b21cbab5394dea8d9a9519e6246af1.scope
mount.nfs: Connection timed out
Warning FailedMount 23m kubelet, nfs-virt1 MountVolume.SetUp failed for volume "nfs-volume" : mount failed: exit status 32
Mounting command: systemd-run
Mounting arguments: --description=Kubernetes transient mount for /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume --scope -- mount -t nfs 10.152.183.136:/ /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume
Output: Running scope as unit: run-r38be2dac85d9479eb9246530b5344877.scope
mount.nfs: Connection timed out
Warning FailedMount 21m kubelet, nfs-virt1 MountVolume.SetUp failed for volume "nfs-volume" : mount failed: exit status 32
Mounting command: systemd-run
Mounting arguments: --description=Kubernetes transient mount for /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume --scope -- mount -t nfs 10.152.183.136:/ /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume
Output: Running scope as unit: run-re4f97ef6cf234625a6de6055f6848e24.scope
mount.nfs: Connection timed out
Warning FailedMount 19m kubelet, nfs-virt1 MountVolume.SetUp failed for volume "nfs-volume" : mount failed: exit status 32
Mounting command: systemd-run
Mounting arguments: --description=Kubernetes transient mount for /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume --scope -- mount -t nfs 10.152.183.136:/ /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume
Output: Running scope as unit: run-r338bc5401ea14fbcb2dc6c55aac518c3.scope
mount.nfs: Connection timed out
Warning FailedMount 17m kubelet, nfs-virt1 MountVolume.SetUp failed for volume "nfs-volume" : mount failed: exit status 32
Mounting command: systemd-run
Mounting arguments: --description=Kubernetes transient mount for /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume --scope -- mount -t nfs 10.152.183.136:/ /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume
Output: Running scope as unit: run-r26be7bb2a8c54985836e9825793dc960.scope
mount.nfs: Connection timed out
Warning FailedMount 14m kubelet, nfs-virt1 MountVolume.SetUp failed for volume "nfs-volume" : mount failed: exit status 32
Mounting command: systemd-run
Mounting arguments: --description=Kubernetes transient mount for /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume --scope -- mount -t nfs 10.152.183.136:/ /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume
Output: Running scope as unit: run-red5e0a72dcad4dc9a0d3d97b3f398795.scope
mount.nfs: Connection timed out
Warning FailedMount 12m kubelet, nfs-virt1 MountVolume.SetUp failed for volume "nfs-volume" : mount failed: exit status 32
Mounting command: systemd-run
Mounting arguments: --description=Kubernetes transient mount for /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume --scope -- mount -t nfs 10.152.183.136:/ /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume
Output: Running scope as unit: run-r228748a1144b41888e84bad1be12388d.scope
mount.nfs: Connection timed out
Warning FailedMount 50s (x3 over 9m5s) kubelet, nfs-virt1 (combined from similar events): MountVolume.SetUp failed for volume "nfs-volume" : mount failed: exit status 32
Mounting command: systemd-run
Mounting arguments: --description=Kubernetes transient mount for /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume --scope -- mount -t nfs 10.152.183.136:/ /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume
Output: Running scope as unit: run-r2cd27edee6c24a47a63cd32439f2e4a4.scope
mount.nfs: Connection timed out
Warning FailedMount 42s (x13 over 27m) kubelet, nfs-virt1 Unable to mount volumes for pod "pod-using-nfs_hyperledger(8c3b3949-6673-11e9-99ae-525400dce7c4)": timeout expired waiting for volumes to attach or mount for pod "hyperledger"/"pod-using-nfs". list of unmounted volumes=[nfs-volume]. list of unattached volumes=[nfs-volume default-token-zf8wr]


this is also true for a few other pods using another volume.
Am I missing something essential?










share|improve this question







New contributor




Yuven is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
















  • 1





    Did you check if the NFS filesystem is actually available on the K8S node?

    – xenoid
    11 hours ago











  • @xenoid, do you have any good way to check that? I followed a guide that set up the nfs, so I thought it might make it available too

    – Yuven
    10 hours ago













  • Log in on the worker node and try to mount it by hand?

    – xenoid
    10 hours ago














0












0








0








Unable to mount volumes for pod "pod-using-nfs_hyperledger(8c3b3949-6673-11e9-99ae-525400dce7c4)": timeout expired waiting for volumes to attach or mount for pod "hyperledger"/"pod-using-nfs". list of unmounted volumes=[nfs-volume]. list of unattached volumes=[nfs-volume default-token-zf8wr]


I get this error when trying to mount pods to volumes on my local setup.
Here is "kubectl describe pod pod-using-nfs -n hyperledger"



Name:         pod-using-nfs
Namespace: hyperledger
Node: nfs-virt1/11.0.0.74
Start Time: Wed, 24 Apr 2019 11:30:07 +0200
Labels: <none>
Annotations: <none>
Status: Pending
IP:
Containers:
app:
Container ID:
Image: alpine
Image ID:
Port: <none>
Host Port: <none>
Command:
/bin/sh
Args:
-c
while true; do date >> /var/nfs/dates.txt; sleep 5; done
State: Waiting
Reason: ContainerCreating
Ready: False
Restart Count: 0
Environment: <none>
Mounts:
/var/nfs from nfs-volume (rw)
/var/run/secrets/kubernetes.io/serviceaccount from default-token-zf8wr (ro)
Conditions:
Type Status
Initialized True
Ready False
ContainersReady False
PodScheduled True
Volumes:
nfs-volume:
Type: NFS (an NFS mount that lasts the lifetime of a pod)
Server: 10.152.183.136
Path: /
ReadOnly: false
default-token-zf8wr:
Type: Secret (a volume populated by a Secret)
SecretName: default-token-zf8wr
Optional: false
QoS Class: BestEffort
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute for 300s
node.kubernetes.io/unreachable:NoExecute for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Scheduled 29m default-scheduler Successfully assigned hyperledger/pod-using-nfs to nfs-virt1
Warning FailedMount 27m kubelet, nfs-virt1 MountVolume.SetUp failed for volume "nfs-volume" : mount failed: exit status 32
Mounting command: systemd-run
Mounting arguments: --description=Kubernetes transient mount for /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume --scope -- mount -t nfs 10.152.183.136:/ /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume
Output: Running scope as unit: run-r3aa4f0d9f3474be0a05dd6f7cfb562f9.scope
mount.nfs: Connection timed out
Warning FailedMount 25m kubelet, nfs-virt1 MountVolume.SetUp failed for volume "nfs-volume" : mount failed: exit status 32
Mounting command: systemd-run
Mounting arguments: --description=Kubernetes transient mount for /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume --scope -- mount -t nfs 10.152.183.136:/ /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume
Output: Running scope as unit: run-r38b21cbab5394dea8d9a9519e6246af1.scope
mount.nfs: Connection timed out
Warning FailedMount 23m kubelet, nfs-virt1 MountVolume.SetUp failed for volume "nfs-volume" : mount failed: exit status 32
Mounting command: systemd-run
Mounting arguments: --description=Kubernetes transient mount for /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume --scope -- mount -t nfs 10.152.183.136:/ /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume
Output: Running scope as unit: run-r38be2dac85d9479eb9246530b5344877.scope
mount.nfs: Connection timed out
Warning FailedMount 21m kubelet, nfs-virt1 MountVolume.SetUp failed for volume "nfs-volume" : mount failed: exit status 32
Mounting command: systemd-run
Mounting arguments: --description=Kubernetes transient mount for /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume --scope -- mount -t nfs 10.152.183.136:/ /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume
Output: Running scope as unit: run-re4f97ef6cf234625a6de6055f6848e24.scope
mount.nfs: Connection timed out
Warning FailedMount 19m kubelet, nfs-virt1 MountVolume.SetUp failed for volume "nfs-volume" : mount failed: exit status 32
Mounting command: systemd-run
Mounting arguments: --description=Kubernetes transient mount for /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume --scope -- mount -t nfs 10.152.183.136:/ /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume
Output: Running scope as unit: run-r338bc5401ea14fbcb2dc6c55aac518c3.scope
mount.nfs: Connection timed out
Warning FailedMount 17m kubelet, nfs-virt1 MountVolume.SetUp failed for volume "nfs-volume" : mount failed: exit status 32
Mounting command: systemd-run
Mounting arguments: --description=Kubernetes transient mount for /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume --scope -- mount -t nfs 10.152.183.136:/ /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume
Output: Running scope as unit: run-r26be7bb2a8c54985836e9825793dc960.scope
mount.nfs: Connection timed out
Warning FailedMount 14m kubelet, nfs-virt1 MountVolume.SetUp failed for volume "nfs-volume" : mount failed: exit status 32
Mounting command: systemd-run
Mounting arguments: --description=Kubernetes transient mount for /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume --scope -- mount -t nfs 10.152.183.136:/ /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume
Output: Running scope as unit: run-red5e0a72dcad4dc9a0d3d97b3f398795.scope
mount.nfs: Connection timed out
Warning FailedMount 12m kubelet, nfs-virt1 MountVolume.SetUp failed for volume "nfs-volume" : mount failed: exit status 32
Mounting command: systemd-run
Mounting arguments: --description=Kubernetes transient mount for /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume --scope -- mount -t nfs 10.152.183.136:/ /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume
Output: Running scope as unit: run-r228748a1144b41888e84bad1be12388d.scope
mount.nfs: Connection timed out
Warning FailedMount 50s (x3 over 9m5s) kubelet, nfs-virt1 (combined from similar events): MountVolume.SetUp failed for volume "nfs-volume" : mount failed: exit status 32
Mounting command: systemd-run
Mounting arguments: --description=Kubernetes transient mount for /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume --scope -- mount -t nfs 10.152.183.136:/ /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume
Output: Running scope as unit: run-r2cd27edee6c24a47a63cd32439f2e4a4.scope
mount.nfs: Connection timed out
Warning FailedMount 42s (x13 over 27m) kubelet, nfs-virt1 Unable to mount volumes for pod "pod-using-nfs_hyperledger(8c3b3949-6673-11e9-99ae-525400dce7c4)": timeout expired waiting for volumes to attach or mount for pod "hyperledger"/"pod-using-nfs". list of unmounted volumes=[nfs-volume]. list of unattached volumes=[nfs-volume default-token-zf8wr]


this is also true for a few other pods using another volume.
Am I missing something essential?










share|improve this question







New contributor




Yuven is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.












Unable to mount volumes for pod "pod-using-nfs_hyperledger(8c3b3949-6673-11e9-99ae-525400dce7c4)": timeout expired waiting for volumes to attach or mount for pod "hyperledger"/"pod-using-nfs". list of unmounted volumes=[nfs-volume]. list of unattached volumes=[nfs-volume default-token-zf8wr]


I get this error when trying to mount pods to volumes on my local setup.
Here is "kubectl describe pod pod-using-nfs -n hyperledger"



Name:         pod-using-nfs
Namespace: hyperledger
Node: nfs-virt1/11.0.0.74
Start Time: Wed, 24 Apr 2019 11:30:07 +0200
Labels: <none>
Annotations: <none>
Status: Pending
IP:
Containers:
app:
Container ID:
Image: alpine
Image ID:
Port: <none>
Host Port: <none>
Command:
/bin/sh
Args:
-c
while true; do date >> /var/nfs/dates.txt; sleep 5; done
State: Waiting
Reason: ContainerCreating
Ready: False
Restart Count: 0
Environment: <none>
Mounts:
/var/nfs from nfs-volume (rw)
/var/run/secrets/kubernetes.io/serviceaccount from default-token-zf8wr (ro)
Conditions:
Type Status
Initialized True
Ready False
ContainersReady False
PodScheduled True
Volumes:
nfs-volume:
Type: NFS (an NFS mount that lasts the lifetime of a pod)
Server: 10.152.183.136
Path: /
ReadOnly: false
default-token-zf8wr:
Type: Secret (a volume populated by a Secret)
SecretName: default-token-zf8wr
Optional: false
QoS Class: BestEffort
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute for 300s
node.kubernetes.io/unreachable:NoExecute for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Scheduled 29m default-scheduler Successfully assigned hyperledger/pod-using-nfs to nfs-virt1
Warning FailedMount 27m kubelet, nfs-virt1 MountVolume.SetUp failed for volume "nfs-volume" : mount failed: exit status 32
Mounting command: systemd-run
Mounting arguments: --description=Kubernetes transient mount for /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume --scope -- mount -t nfs 10.152.183.136:/ /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume
Output: Running scope as unit: run-r3aa4f0d9f3474be0a05dd6f7cfb562f9.scope
mount.nfs: Connection timed out
Warning FailedMount 25m kubelet, nfs-virt1 MountVolume.SetUp failed for volume "nfs-volume" : mount failed: exit status 32
Mounting command: systemd-run
Mounting arguments: --description=Kubernetes transient mount for /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume --scope -- mount -t nfs 10.152.183.136:/ /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume
Output: Running scope as unit: run-r38b21cbab5394dea8d9a9519e6246af1.scope
mount.nfs: Connection timed out
Warning FailedMount 23m kubelet, nfs-virt1 MountVolume.SetUp failed for volume "nfs-volume" : mount failed: exit status 32
Mounting command: systemd-run
Mounting arguments: --description=Kubernetes transient mount for /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume --scope -- mount -t nfs 10.152.183.136:/ /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume
Output: Running scope as unit: run-r38be2dac85d9479eb9246530b5344877.scope
mount.nfs: Connection timed out
Warning FailedMount 21m kubelet, nfs-virt1 MountVolume.SetUp failed for volume "nfs-volume" : mount failed: exit status 32
Mounting command: systemd-run
Mounting arguments: --description=Kubernetes transient mount for /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume --scope -- mount -t nfs 10.152.183.136:/ /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume
Output: Running scope as unit: run-re4f97ef6cf234625a6de6055f6848e24.scope
mount.nfs: Connection timed out
Warning FailedMount 19m kubelet, nfs-virt1 MountVolume.SetUp failed for volume "nfs-volume" : mount failed: exit status 32
Mounting command: systemd-run
Mounting arguments: --description=Kubernetes transient mount for /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume --scope -- mount -t nfs 10.152.183.136:/ /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume
Output: Running scope as unit: run-r338bc5401ea14fbcb2dc6c55aac518c3.scope
mount.nfs: Connection timed out
Warning FailedMount 17m kubelet, nfs-virt1 MountVolume.SetUp failed for volume "nfs-volume" : mount failed: exit status 32
Mounting command: systemd-run
Mounting arguments: --description=Kubernetes transient mount for /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume --scope -- mount -t nfs 10.152.183.136:/ /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume
Output: Running scope as unit: run-r26be7bb2a8c54985836e9825793dc960.scope
mount.nfs: Connection timed out
Warning FailedMount 14m kubelet, nfs-virt1 MountVolume.SetUp failed for volume "nfs-volume" : mount failed: exit status 32
Mounting command: systemd-run
Mounting arguments: --description=Kubernetes transient mount for /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume --scope -- mount -t nfs 10.152.183.136:/ /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume
Output: Running scope as unit: run-red5e0a72dcad4dc9a0d3d97b3f398795.scope
mount.nfs: Connection timed out
Warning FailedMount 12m kubelet, nfs-virt1 MountVolume.SetUp failed for volume "nfs-volume" : mount failed: exit status 32
Mounting command: systemd-run
Mounting arguments: --description=Kubernetes transient mount for /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume --scope -- mount -t nfs 10.152.183.136:/ /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume
Output: Running scope as unit: run-r228748a1144b41888e84bad1be12388d.scope
mount.nfs: Connection timed out
Warning FailedMount 50s (x3 over 9m5s) kubelet, nfs-virt1 (combined from similar events): MountVolume.SetUp failed for volume "nfs-volume" : mount failed: exit status 32
Mounting command: systemd-run
Mounting arguments: --description=Kubernetes transient mount for /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume --scope -- mount -t nfs 10.152.183.136:/ /var/lib/kubelet/pods/8c3b3949-6673-11e9-99ae-525400dce7c4/volumes/kubernetes.io~nfs/nfs-volume
Output: Running scope as unit: run-r2cd27edee6c24a47a63cd32439f2e4a4.scope
mount.nfs: Connection timed out
Warning FailedMount 42s (x13 over 27m) kubelet, nfs-virt1 Unable to mount volumes for pod "pod-using-nfs_hyperledger(8c3b3949-6673-11e9-99ae-525400dce7c4)": timeout expired waiting for volumes to attach or mount for pod "hyperledger"/"pod-using-nfs". list of unmounted volumes=[nfs-volume]. list of unattached volumes=[nfs-volume default-token-zf8wr]


this is also true for a few other pods using another volume.
Am I missing something essential?







linux nfs kubernetes






share|improve this question







New contributor




Yuven is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.











share|improve this question







New contributor




Yuven is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.









share|improve this question




share|improve this question






New contributor




Yuven is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.









asked 14 hours ago









YuvenYuven

1




1




New contributor




Yuven is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.





New contributor





Yuven is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.






Yuven is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.








  • 1





    Did you check if the NFS filesystem is actually available on the K8S node?

    – xenoid
    11 hours ago











  • @xenoid, do you have any good way to check that? I followed a guide that set up the nfs, so I thought it might make it available too

    – Yuven
    10 hours ago













  • Log in on the worker node and try to mount it by hand?

    – xenoid
    10 hours ago














  • 1





    Did you check if the NFS filesystem is actually available on the K8S node?

    – xenoid
    11 hours ago











  • @xenoid, do you have any good way to check that? I followed a guide that set up the nfs, so I thought it might make it available too

    – Yuven
    10 hours ago













  • Log in on the worker node and try to mount it by hand?

    – xenoid
    10 hours ago








1




1





Did you check if the NFS filesystem is actually available on the K8S node?

– xenoid
11 hours ago





Did you check if the NFS filesystem is actually available on the K8S node?

– xenoid
11 hours ago













@xenoid, do you have any good way to check that? I followed a guide that set up the nfs, so I thought it might make it available too

– Yuven
10 hours ago







@xenoid, do you have any good way to check that? I followed a guide that set up the nfs, so I thought it might make it available too

– Yuven
10 hours ago















Log in on the worker node and try to mount it by hand?

– xenoid
10 hours ago





Log in on the worker node and try to mount it by hand?

– xenoid
10 hours ago










0






active

oldest

votes












Your Answer








StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "3"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});

function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});


}
});






Yuven is a new contributor. Be nice, and check out our Code of Conduct.










draft saved

draft discarded


















StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fsuperuser.com%2fquestions%2f1429027%2fk8s-unable-to-mount-volumes-for-pod%23new-answer', 'question_page');
}
);

Post as a guest















Required, but never shown

























0






active

oldest

votes








0






active

oldest

votes









active

oldest

votes






active

oldest

votes








Yuven is a new contributor. Be nice, and check out our Code of Conduct.










draft saved

draft discarded


















Yuven is a new contributor. Be nice, and check out our Code of Conduct.













Yuven is a new contributor. Be nice, and check out our Code of Conduct.












Yuven is a new contributor. Be nice, and check out our Code of Conduct.
















Thanks for contributing an answer to Super User!


  • Please be sure to answer the question. Provide details and share your research!

But avoid



  • Asking for help, clarification, or responding to other answers.

  • Making statements based on opinion; back them up with references or personal experience.


To learn more, see our tips on writing great answers.




draft saved


draft discarded














StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fsuperuser.com%2fquestions%2f1429027%2fk8s-unable-to-mount-volumes-for-pod%23new-answer', 'question_page');
}
);

Post as a guest















Required, but never shown





















































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown

































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown







Popular posts from this blog

Couldn't open a raw socket. Error: Permission denied (13) (nmap)Is it possible to run networking commands...

VNC viewer RFB protocol error: bad desktop size 0x0I Cannot Type the Key 'd' (lowercase) in VNC Viewer...

Why not use the yoke to control yaw, as well as pitch and roll? Announcing the arrival of...