Hadoop Resourcemanager

Learn about actions >

• mrbench

  Mapreduce benchmark for small jobs

  Params

  • basedir string

    DFS working directory

  • inputlines integer

    number of input lines to generate

  • inputtype string

    Type of input to generate, one of [ascending, descending, random]

  • maps integer

    number of maps for each run

  • numruns integer

    Number of times to run the job

  • reduces integer

    number of reduces for each run

• nnbench

  Load test the NameNode hardware and configuration

  Params

  • basedir string

    DFS working directory

  • blocksize integer

    block size

  • bytes integer

    bytes to write

  • maps integer

    number of map jobs

  • numfiles integer

    number of files

  • reduces integer

    number of reduces

  • repfactor integer

    replication factor per file

• reinstall

  Reinstall packages with the version available in the repo.

• smoke-test

  Run an Apache Bigtop smoke test.

• teragen

  Generate data with teragen

  Params

  • indir string

    HDFS directory where generated data is stored

  • size string

    The number of 100 byte rows, default to 1GB of data to generate

• terasort

  Runs teragen to generate sample data, and then runs terasort to sort that data

  Params

  • compression string

    Enable or Disable mapred output (intermediate) compression. LocalDefault will run with your current local hadoop configuration. Default means default hadoop deflate codec. One of: Gzip, BZip2, Snappy, Lzo, Default, Disable, LocalDefault These are all case sensitive.

  • indir string

    HDFS directory where generated data is stored

  • maps integer

    The default number of map tasks per job. 1-20

  • numtasks integer

    How many tasks to run per jvm. If set to -1, there is no limit.

  • outdir string

    HDFS directory where sorted data is stored

  • reduces integer

    The default number of reduce tasks per job. Typically set to 99% of the cluster's reduce capacity, so that if a node fails the reduces can still be executed in a single wave. Try 1-20

  • size string

    The number of 100 byte rows, default to 1GB of data to generate and sort

• testdfsio

  DFS IO Testing

  Params

  • buffersize string

    Buffer size in bytes

  • filesize integer

    filesize in MB

  • mode string

    read or write IO test

  • numfiles integer

    number of files