Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

configmap file mount path results in command not found error #44815

Closed
pmcgrath opened this issue Apr 23, 2017 · 10 comments
Closed

configmap file mount path results in command not found error #44815

pmcgrath opened this issue Apr 23, 2017 · 10 comments

Comments

@pmcgrath
Copy link

Is this a request for help? (If yes, you should use our troubleshooting guide and community support channels, see http://kubernetes.io/docs/troubleshooting/.): No

What keywords did you search in Kubernetes issues before filing this one? (If you have found any duplicates, you should instead reply there.): command not found configmap kubernetes


Is this a BUG REPORT or FEATURE REQUEST? (choose one): BUG

Kubernetes version (use kubectl version):
Client Version: v1.6.1 GitCommit:"b0b7a323cc5a4a2019b2e9520c21c7830b7f708e"
Server Version: v1.6.0 GitCommit:"fff5156092b56e6bd60fff75aad4dc9de6b6ef37

Environment:

  • Cloud provider or hardware configuration:
  • OS (e.g. from /etc/os-release): host is ubuntu 16.04
  • Kernel (e.g. uname -a): host is Linux dev1 4.4.0-72-generic Improved commit hook #93-Ubuntu SMP Fri Mar 31 14:07:41 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
  • Install tools:
  • Others: Running from within minikube version: v0.18.0

What happened:
When I try to create a deployment with a configmap file that is mounted into the same directory as the entry point , the container fails to start with the following error
"Error response from daemon: Container command '/app/app.sh' not found or does not exist."
The pod spec includes a configmap which is mounted into the same directory as the entrypoint

Seems the entry point script is lost after mounting the volume for the config map in the same directory
If I mount the configmap file into a sub directory all works as expected

What you expected to happen:
I expected the config map file to be created in the directory without effecting the existing directory content which in this case contains an entrypoint script

How to reproduce it (as minimally and precisely as possible):

Docker file - note the entry point

FROM busybox:latest

RUN        mkdir /app
COPY       app.sh /app

ENTRYPOINT ["/app/app.sh"]

Entry point script - infinite loop

#!/bin/sh
seq=1
while [[ true ]]; do
	echo "${seq} $(date) working"
	sleep .5s	
	let seq=$((seq + 1))
done

k8s configmap and deployment file

apiVersion: v1
kind: ConfigMap
metadata:
  labels:
    product: k8s-demo
  name: demo
data:
  settings.json: |
    {
      "store": {
        "type": "InMemory",
    }

---
apiVersion: apps/v1beta1
kind: Deployment
metadata:
  labels:
    product: k8s-demo
  name: demo
spec:
  replicas: 1
  template:
    metadata:
      labels:
        app: demo
        product: k8s-demo
    spec:
      containers:
      - name: demo
        image: pmcgrath/shellloop:1
        imagePullPolicy: Always
        volumeMounts:
          - name: demo-config
            mountPath: /app
      volumes:
        - name: demo-config
          configMap:
            name: demo
            items:
              - key: settings.json
                path: settings.json 

When I run the kubectl apply -d k8s.yaml and look at the pod I can see the following error

rpc error: code = 2 desc = failed to start container "f9e0112c80ebba568d4b508f99ffb053bf1ae5a4f095ce7f45bff5f38900b617": Error response from daemon: Container command '/app/app.sh' not found or does not exist.

Anything else we need to know:
If I change the mountPath for the volume to any other directory it works as expected

I did test this directly with docker on my host (17.03.0-ce) and it worked as expected

touch settings.json
docker container run -ti -v $(pwd)/settings.json:/app/settings.json pmcgrath/shellloop:1
@zhouhaibing089
Copy link
Contributor

zhouhaibing089 commented Apr 25, 2017

@pmcgrath

Checkout here.

it seems I understand your issue. I have the same question before, but there is an answer actually in your situation.

To brief your case, you have a configmap(settings.json: blahblah), and want to mount into a folder /app. Then below is what you need to know:

  1. Once you mount a volume(no matter it is configmap or others), it overrides the mountPath, so in your case, the /app folder will only contain settings.json.
  2. I know it is not what you expected, so you have to specify the mountPath: /app/settings.json, only that way, the original content in /app folders won't be affected.
  3. well, when you do the second step, you remember that configmap is actually a list of key-value pairs, you only need one of the keys(though you actually have only one as well), so you need to tell the volume mounts to use a subpath from you configmap.

This is something that you will get eventually:

containers:
- volumeMounts:
  - name: demo-config
    mountPath: /app/settings.json
    subPath: settings.json
volumes:
- name: demo-config
  configMap:
    name: demo

@pmcgrath
Copy link
Author

@zhouhaibing089
Thanks for the reply, works based on your suggestion, I appreciate the explanation

I am happy to close this issue
Pat

@agilgur5
Copy link

agilgur5 commented Nov 2, 2017

For reference, the original mention of this solution seems to be here: #23748 (comment)

It looks like the documentation for this is missing, which makes this case fairly confusing/misleading, and the projection docs seem to make it more misleading as well -- not sure if it's missing because auto updates apparently don't work as per that issue

@emwalker
Copy link
Contributor

The requirement for the file name to be specified both under mountPath and subPath is counterintuitive.

@vishaltelangre
Copy link

The solution provided by @zhouhaibing089 works but the content of the mounted file at subPath doesn't update if we edit it in the resembled ConfigMap.

@leebenson
Copy link

IMO, this isn't really solved. There should be an option to append each key rather than overwrite.

Something like:

kind: ConfigMap
apiVersion: v1
metadata:
  name: nginx-conf
data:
  example1.conf: |
    server {
      server_name example1.com;
      # config here...
    }
  example2.conf: |
    server {
      server_name example2.com;
      # config here...
    }

So that...

- name: nginx-conf
  mountPath: /etc/nginx/conf.d
  append: true

... keeps the existing default.conf and any other artefacts of the Docker image, but augments with example*.conf

Repeating the same info in subPath is just icky.

@mehemken
Copy link

+1 on @leebenson 's append: true option.

@val1715
Copy link

val1715 commented Mar 12, 2019

According to @leebenson answer: can anyone explain where from is coming append: true option ??

it does not work for me, i got:

error: error validating "hdfs/21-namenode-statefulset.yaml": error validating data: ValidationError(StatefulSet.spec.template.spec.containers[1].volumeMounts[1]): unknown field "append" in io.k8s.api.core.v1.VolumeMount; if you choose to ignore these errors, turn validation off with --validate=false

Also, it is not present in api docs for volume mount :
https://k8smeetup.github.io/docs/api-reference/v1.9/#volumemount-v1-core

@Zvikan
Copy link

Zvikan commented Mar 18, 2019

According to @leebenson answer: can anyone explain where from is coming append: true option ??

it does not work for me, i got:

error: error validating "hdfs/21-namenode-statefulset.yaml": error validating data: ValidationError(StatefulSet.spec.template.spec.containers[1].volumeMounts[1]): unknown field "append" in io.k8s.api.core.v1.VolumeMount; if you choose to ignore these errors, turn validation off with --validate=false

Also, it is not present in api docs for volume mount :
https://k8smeetup.github.io/docs/api-reference/v1.9/#volumemount-v1-core

it doesn't exist, it's a suggestion. a good one for the use case.

@fulopbede
Copy link

fulopbede commented Apr 24, 2019

I tried to use this method, but I got a Read-only file system error, when I applied the statefulset. Does anyone know how to fix that?
(I'm overwriting an existing file, that contains settings for elasticsearch, actual error message --> /usr/share/elasticsearch/bin/run.sh: line 28: ./config/elasticsearch.yml: Read-only file system)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

10 participants