{"id":2702,"date":"2019-05-10T16:32:43","date_gmt":"2019-05-10T14:32:43","guid":{"rendered":"http:\/\/miro.borodziuk.eu\/?p=2702"},"modified":"2019-08-29T23:29:22","modified_gmt":"2019-08-29T21:29:22","slug":"elastic-file-system","status":"publish","type":"post","link":"http:\/\/miro.borodziuk.eu\/index.php\/2019\/05\/10\/elastic-file-system\/","title":{"rendered":"Elastic File System (EFS)"},"content":{"rendered":"<p>Amazon EFS is an implementation of the Network File System (NFSv4) delivered as a service. File systems can be created and mounted on multiple Linux instances at the same time. Use EFS when you need a &#8220;file system&#8221; that can be accessed from multiple instances (e.g., shared media, home folders, documentation, shared logs).<\/p>\n<p><!--more--><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-2775 aligncenter\" src=\"http:\/\/miro.borodziuk.eu\/wp-content\/uploads\/EFS-1.jpg\" alt=\"\" width=\"619\" height=\"628\" srcset=\"http:\/\/miro.borodziuk.eu\/wp-content\/uploads\/EFS-1.jpg 619w, http:\/\/miro.borodziuk.eu\/wp-content\/uploads\/EFS-1-296x300.jpg 296w, http:\/\/miro.borodziuk.eu\/wp-content\/uploads\/EFS-1-100x100.jpg 100w\" sizes=\"(max-width: 619px) 100vw, 619px\" \/><\/p>\n<p>1. Highly available, scalable file system:<\/p>\n<ul>\n<li style=\"list-style-type: none;\">\n<ul>\n<li>Spans multiple Availability Zones<\/li>\n<li>Throughput for parallel workloads:\u00a0 Big Data, Analytics, Media Processing, Content Management, Web Serving<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p>2. Shared data store that can be mounted to multiple EC2 instances or on-premises servers:<\/p>\n<ul>\n<li style=\"list-style-type: none;\">\n<ul>\n<li>For on-premises servers, use AWS Direct Connect or AWS VPN<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p>3. Linux-only;\u00a0 Windows is not supported<\/p>\n<p>4. Two performance modes:<\/p>\n<ul>\n<li style=\"list-style-type: none;\">\n<ul>\n<li>General Purpose &#8211; the default and suitable for 99% of needs)<\/li>\n<li>Max I\/O &#8211; designed for when a large number of instances [as in, hundreds] need to access the file system. Scales throughput and IOPS (slightly higher latencies)<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p>5. Bursting:<\/p>\n<ul>\n<li style=\"list-style-type: none;\">\n<ul>\n<li>Burst to 100 MiB\/s for any size file system<\/li>\n<li>Larger than 1 TiB = bursting 100 MiB\/s per TiB of data stored<\/li>\n<li>Credit system: Earns credits at 50 MiB\/s per TiB of data stored<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p>6. <strong>Security groups<\/strong> should be used to control NFS traffic<\/p>\n<ul>\n<li style=\"list-style-type: none;\">\n<ul>\n<li>Use the EC2 security group as the source<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p>7. Supports <strong>encryption <\/strong>at <strong>rest<\/strong> and in<strong> transit<\/strong><\/p>\n<p>8. Storage classes and lifecycle management:<\/p>\n<ul>\n<li style=\"list-style-type: none;\">\n<ul>\n<li>Standard<\/li>\n<li>Infrequent Access (IA)<\/li>\n<li>Lifecycle management automatically moves files to IA not accessed for 30 days<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<ul>\n<li>Its base entity is a file system.<\/li>\n<li>The file system is accessed via &#8220;mount targets&#8221; that are placed in subnets inside a VPC and have an IP address. The file system is &#8220;mounted&#8221; on Linux instances<\/li>\n<li>File systems are accessible from a VPC or from on-premises locations via a VPN or Direct Connect.<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<p><span style=\"color: #3366ff;\">CloudWatch Metrics<\/span><\/p>\n<ul>\n<li><code>BurstCreditBatance <\/code><\/li>\n<li><code>ClientConnections <\/code><\/li>\n<li><code>DataReadI0Bytes <\/code><\/li>\n<li><code>DataWriteI0Bytes<\/code><\/li>\n<li><code>MetadataI0Bytes <\/code><\/li>\n<li><code>PercentIOLimit <\/code><\/li>\n<li><code>PermittedThroughput <\/code><\/li>\n<li><code>TotalI0Bytes<\/code><\/li>\n<\/ul>\n<p>EFS metric data is sent to CloudWatch at one-minute intervals and retained for 15 months.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Amazon EFS is an implementation of the Network File System (NFSv4) delivered as a service. File systems can be created and mounted on multiple Linux instances at the same time. Use EFS when you need a &#8220;file system&#8221; that can be accessed from multiple instances (e.g., shared media, home folders, documentation, shared logs).<\/p>\n","protected":false},"author":1,"featured_media":2707,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[77],"tags":[],"_links":{"self":[{"href":"http:\/\/miro.borodziuk.eu\/index.php\/wp-json\/wp\/v2\/posts\/2702"}],"collection":[{"href":"http:\/\/miro.borodziuk.eu\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/miro.borodziuk.eu\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/miro.borodziuk.eu\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/miro.borodziuk.eu\/index.php\/wp-json\/wp\/v2\/comments?post=2702"}],"version-history":[{"count":11,"href":"http:\/\/miro.borodziuk.eu\/index.php\/wp-json\/wp\/v2\/posts\/2702\/revisions"}],"predecessor-version":[{"id":2779,"href":"http:\/\/miro.borodziuk.eu\/index.php\/wp-json\/wp\/v2\/posts\/2702\/revisions\/2779"}],"wp:featuredmedia":[{"embeddable":true,"href":"http:\/\/miro.borodziuk.eu\/index.php\/wp-json\/wp\/v2\/media\/2707"}],"wp:attachment":[{"href":"http:\/\/miro.borodziuk.eu\/index.php\/wp-json\/wp\/v2\/media?parent=2702"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/miro.borodziuk.eu\/index.php\/wp-json\/wp\/v2\/categories?post=2702"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/miro.borodziuk.eu\/index.php\/wp-json\/wp\/v2\/tags?post=2702"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}