CDH：cdh5 环境 mkdir: Permission denied: user=root, access=WRITE, inode="/user":hdfs:hadoop:...

产生问题原因：

环境 hadoop2，cdh5 创建
使用 hadoop fs -mdkir /use/xxx 创建文件路径时，出现权限问题

前提我们已经把当前用户 zhangsan 和 root 放到 /etc/suders 中。

su root

vi /etc/sudoers
root ALL=(ALL) ALL
zhangsan ALL=(ALL) NOPASSWD:ALL

su zhangsan
[zhangsan@cdh107 ~]$ hadoop fs -ls /user
Found 7 items
drwxrwxrwx - mapred hadoop 0 2018-11-12 14:07 /user/history
drwxrwxr-t - hive hive 0 2018-11-12 14:09 /user/hive
drwxrwxr-x - hue hue 0 2018-11-12 14:09 /user/hue
drwxrwxr-x - impala impala 0 2018-11-12 14:09 /user/impala
drwxrwxr-x - oozie oozie 0 2018-11-12 14:09 /user/oozie
drwxr-x--x - spark spark 0 2018-11-12 15:14 /user/spark
drwxrwxr-x - sqoop2 sqoop 0 2018-11-12 14:08 /user/sqoop2

创建目录 /user/zhangsan 抛出异常：

[zhangsan@cdh107 ~]$ hadoop fs -mkdir /user/wangyou
mkdir: Permission denied: user=zhangsan, access=WRITE, inode="/user":hdfs:supergroup:drwxr-xr-x
[zhangsan@cdh107 ~]$ sudo hadoop fs -mkdir /user/wangyou
mkdir: Permission denied: user=root, access=WRITE, inode="/user":hdfs:supergroup:drwxr-xr-x

解决步骤：

1. 查看 /user 目录的用户和用户组

[zhangsan@cdh107 ~]$ hadoop fs -ls /
Found 3 items
drwxr-xr-x - hbase hbase 0 2018-11-12 14:59 /hbase
drwxrwxrwt - hdfs supergroup 0 2018-11-12 14:09 /tmp
drwxr-xr-x - hdfs supergroup 0 2018-11-12 14:09 /user

备注：从上边可以看出我们想在 /user 路径下创建用户，但是 /user 路径的用户是 hdfs，用户组是 supergroup，当我们使用 zhangsan 或者 root 时提示创建失败，因此我们要修改创建 /user/wangyou 的用户。

2. 使用 hdfs 这个用户登录来创建目录 /user/wangyou

[zhangsan@cdh107 ~]$ sudo -uhdfs hadoop fs -mkdir /user/wangyou
[zhangsan@cdh107 ~]$ hadoop fs -ls /user
Found 8 items
drwxr-xr-x - hdfs supergroup 0 2018-11-13 16:43 /user/wangyou
drwxrwxrwx - mapred hadoop 0 2018-11-12 14:07 /user/history
drwxrwxr-t - hive hive 0 2018-11-12 14:09 /user/hive
drwxrwxr-x - hue hue 0 2018-11-12 14:09 /user/hue
drwxrwxr-x - impala impala 0 2018-11-12 14:09 /user/impala
drwxrwxr-x - oozie oozie 0 2018-11-12 14:09 /user/oozie
drwxr-x--x - spark spark 0 2018-11-12 15:14 /user/spark
drwxrwxr-x - sqoop2 sqoop 0 2018-11-12 14:08 /user/sqoop2

3. 通过 hdfs 用户更改所在用户的权限

[zhangsan@cdh107 ~]$ sudo -uhdfs hadoop fs -chown zhangsan:zhangsan /user/wangyou
[zhangsan@cdh107 ~]$ hadoop fs -ls /user
Found 8 items
drwxr-xr-x - zhangsan zhangsan 0 2018-11-13 16:43 /user/wangyou
drwxrwxrwx - mapred hadoop 0 2018-11-12 14:07 /user/history
drwxrwxr-t - hive hive 0 2018-11-12 14:09 /user/hive
drwxrwxr-x - hue hue 0 2018-11-12 14:09 /user/hue
drwxrwxr-x - impala impala 0 2018-11-12 14:09 /user/impala
drwxrwxr-x - oozie oozie 0 2018-11-12 14:09 /user/oozie
drwxr-x--x - spark spark 0 2018-11-12 15:14 /user/spark
drwxrwxr-x - sqoop2 sqoop 0 2018-11-12 14:08 /user/sqoop2

 如果 spark2-shell 出现这个错误，如何解决参考《问题解决：Permission denied: user=root, access=WRITE, inode="/user":hdfs:supergroup:drwxr-xr-x》

centos7 设置 mysql 自启动的配置文件中 [Service] User=mysql Group=mysql，user 和 group 这边的 mysql 是指的什么？centos 的登录用户名？

centos7 设置 mysql 自启动的配置文件中

[Unit]
Description=MySQL Server
Documentation=man:mysqld(8)
Documentation=http://dev.mysql.com/doc/refman/en/using-systemd.html
After=network.target
After=syslog.target

[Install]
WantedBy=multi-user.target

[Service]
User=mysql
Group=mysql
ExecStart=/usr/local/mysql/bin/mysqld --defaults-file=/etc/my.cnf
LimitNOFILE = 5000
#Restart=on-failure
#RestartPreventExitStatus=1
#PrivateTmp=false

这里的

[Service]

User=mysql

Group=mysql，

user 和 group 这边的 mysql 是指的什么？centos 的登录用户名？还是其他呢？

Django 认证 —— 自定义 User 模型和在 adminsite 中创建 User

步骤如下：

一：在 settings 中指定用户模型

AUTH_USER_MODEL = ''authentication.CustomUser''

authentication 为 app 的名字，CustomUser 为自定义的用户模型

二：定义用户模型和管理器

在 authentication/models.py 中 ，代码如下

from django.db import models
from django.contrib.auth.models import BaseUserManager, AbstractBaseUser
from django.utils import timezone


class CustomUserManager(BaseUserManager):

    def create_user(self, email, password):
        """Create a user"""
        if not email:
            raise ValueError("邮箱地址不能为空")

        user = self.model(email=self.normalize_email(email),
                          last_login=timezone.now())
        user.set_password(password)
        user.save(using=self._db)
        return user

    def create_superuser(self, email, password):
        """Create a superuser"""
        user = self.create_user(email, password)
        user.is_admin = True
        user.save(using=self._db)
        return user


class CustomUser(AbstractBaseUser):
    email = models.EmailField(primary_key=True, max_length=255, unique=True)
    is_active = models.BooleanField(default=True)
    is_admin = models.BooleanField(default=False)
    objects = CustomUserManager()

    USERNAME_FIELD = ''email''

    class Meta:
        pass

    def get_full_name(self):
        pass

    def get_short_name(self):
        pass

    def has_perm(self, perm, obj=None):
        "Does the user have a specific permission?"
        # Simplest possible answer: Yes, always
        return True

    def has_module_perms(self, app_label):
        "Does the user have permissions to view the app `app_label`?"
        # Simplest possible answer: Yes, always
        return True

    @property
    def is_staff(self):
        "Is the user a member of staff?"
        # Simplest possible answer: All admins are staff
        return self.is_admin

三：迁移数据库

在命令行中输入 python manage.py makemigrations, python manage.py migrate

注意：在定义自定义用户模型之前要保证以前没执行过以上命令

四：创建 admin

命令行输入 python manage.py createsuperuser

五：使用 adminsite 创建 User

在 authentication/admin.py 中，代码如下

from django import forms
from django.contrib import admin
from django.contrib.auth.models import Group
from django.contrib.auth.admin import UserAdmin as BaseUserAdmin
from django.contrib.auth.forms import ReadOnlyPasswordHashField

from .models import CustomUser


class UserCreationForm(forms.ModelForm):
    password1 = forms.CharField(widget=forms.PasswordInput)
    password2 = forms.CharField(widget=forms.PasswordInput)

    class Meta:
        model = CustomUser
        fields = (''email'',)

    def clean_password2(self):
        password1 = self.cleaned_data.get(''password1'')
        password2 = self.cleaned_data.get(''password2'')
        if password1 and password2 and password1 != password2:
            raise forms.ValidationError(''密码不正确'')
        return password2

    def save(self, commit=True):
        user = super(UserCreationForm, self).save(commit=False)
        user.set_password(self.cleaned_data[''password1''])
        if commit:
            user.save()
        return user


class UserChangeForm(forms.ModelForm):
    password = ReadOnlyPasswordHashField()

    class Meta:
        model = CustomUser
        fields = (''email'', ''password'')

    def clean_password(self):
        return self.initial[''password'']


class UserAdmin(BaseUserAdmin):
    form = UserChangeForm
    add_form = UserCreationForm

    list_display = (''email'', ''is_admin'')
    list_filter = (''is_admin'',)
    fieldsets = (
        (None, {''fields'': (''email'', ''password'')}),
        (''Personal info'', {''fields'': (''last_login'',)}),
        (''Permissions'', {''fields'': (''is_admin'',)}),
    )
    add_fieldsets = (
        (None, {
            ''classes'': (''wide'',),
            ''fields'': (''email'', ''last_login'', ''password1'', ''password2'')}
         ),
    )
    search_fields = (''email'',)
    ordering = (''email'',)
    filter_horizontal = ()

# Now register the new UserAdmin
admin.site.register(CustomUser, UserAdmin)
admin.site.unregister(Group)

现在就能使用 adminsite 创建用户了

引用用户模型

不要直接使用自定义的用户模型，这里就是 CustomUser。相反应该使 django.contrib.auth.get_user_model() ，该函数会返回当前指定的用户模型。

当在一个模型中定义外键或多对多关系要使用 CustomUser 模型时，使用 settings.AUTH_USER_MODEL

我们今天的关于MySQL:关于 unauthenticated user和mysql: unrecognized service的分享已经告一段落，感谢您的关注，如果您想了解更多关于'Stream' 类型的值不能从函数 'user' 返回，因为它的返回类型是 'Stream?'、CDH：cdh5 环境 mkdir: Permission denied: user=root, access=WRITE, inode="/user":hdfs:hadoop:...、centos7 设置 mysql 自启动的配置文件中 [Service] User=mysql Group=mysql，user 和 group 这边的 mysql 是指的什么？centos 的登录用户名？、Django 认证 —— 自定义 User 模型和在 adminsite 中创建 User的相关信息，请在本站查询。