DataFaker - the most powerful fake data generation library

A hands-on presentation about DataFaker a library to generate fake data for the JVM (Java, Kotlin, Groovy).

Transcript

1. DataFaker The most powerful fake data generation library @eliasnogueira
2. ELIAS NOGUEIRA Senior Principal Software Engineer Brazil Java Champion Oracle ACE Pro Java Magazine NL Editor
3. The problem we will solve
4. address=XmcWoqivEzSoUwEksGNjlzrjUmWKKCIDOTsDnPAlHPQMJaWYzt age=0 Meaningful data Generate random fixed data name=John Doe email=john.doe@gmail.com No data requirement focus https://speakerdeck.com/eliasnogueira/managing-test-data https://speakerdeck.com/eliasnogueira/managing-test-data
5. { "name": "gAqXOiRGeYiYFHcUOBODzfIQyMmJhUIBJQKqbgamCAlrNlPgxb", "age": 99, "addresses": [ { "line_1": "XGWCgCJcufQlNeqBeXzjcWEVDeIVkJ", "line_2": "sHMZCiNipBcZyfMGZTYYVfRZCTrQySLOwpJSQdHZhrsWznnsSn", "building_number": "64126021", "postcode": "vUdzNyBenk", "town_or_city": "jbeZQMWfKgxEVUYNlJSr", "district": "LOoKXHKNppaFUBy", "country": "AcqwFQFIEB", "latitude": 1.1111111, "longitude": -2.222222 } ] } All the problems together
6. How we will solve it?
7. Address (any pieces), latitude, longitude IBAN, BIC, credit card, stock, routing number DataFaker Any composition, suffix, prefix Credit card, security code, card type Domain, e-mail, image, IP address, password Different providers to help you! Names Address Finance Business Internet +200 Generating fake data for the JVM (Java, Kotlin, Groovy) has never been easier!
8. Generation in a nutshell The connections between the YML file and the code. Sometimes it has some logic. This file contains the data generated by DataFaker. It supports different locales. YML file Provider class
9. DataFaker Concepts Base Providers Transformation Schemas Real life usage How to create yours Repeatable Results
10. Base Providers
11. Base Providers Generator Code Output Names faker.name().fullName() Clemente Lemke Address faker.address().fullAddress() Apt. 984 62551 Brooke Expressway, Chinmouth, WA 55746 Finance faker.finance().iban() NL31RJCK5939950627 Business faker.business().creditCardNumber() 5202-4875-5936-5334 Internet faker.internet().image() https://picsum.photos/640/480 More than 200 providers available
12. Repeatable Results
13. Transformation Schemas @Test public void predictableData() { Faker fakerPredictable = new Faker(new Random(0)); String name = fakerPredictable.name().fullName(); String address = fakerPredictable.address().fullAddress(); LOGGER.info(name); LOGGER.info(address); } [INFO ] Miss Lavina Waelchi [INFO ] 194 Allison Drive, Strackeview, MT 10384 Output
14. Transformation Schemas
15. Transformation Schemas CSV JSON SQL YAML XML Java Schema is a set of rules describing what should be done to transform data from Datafaker representation to one of the supported formats
16. Transformation Schemas Faker faker = new Faker(); Schema<String, String> personSchema = Schema.of( field("name", () -> faker.name().nameWithMiddle()), field("username", () -> faker.internet().username()), field("email", () -> faker.internet().emailAddress()), field("password", () -> faker.internet().password(8, 12)) );
17. Transformation Schemas /* * SQL Data Transformation */ SqlTransformer<String> sqlTransformer = new SqlTransformer.SqlTransformerBuilder<String>() .batch(5) .tableName("MY_TABLE") .dialect(SqlDialect.POSTGRES) .build(); String output = sqlTransformer.generate(personSchema, 10); /* * CSV Data Transformation */ CsvTransformer<String> csvTransformer = CsvTransformer.<String>builder().header(true).separator(COMMA).build(); String csvOutput = csvTransformer.generate(retrieveSchema(), 5);
18. Transformation Schemas CSV Output "name","username","email","password" "Myra Lemke Zulauf","giovanni.hartmann","karima.ullrich@yahoo.com","49uv48051" "Elijah Kautzer Hudson","carlota.haag","adam.sanford@gmail.com","292ka97i5" "Loraine Simonis Dach","renee.ondricka","latrisha.gutmann@hotmail.com","9vt5tr7i0" "George Stiedemann Roob","idella.crist","trinh.carter@yahoo.com","4134aqt8q" "Derek Runolfsdottir Spinka","marcel.simonis","doug.kub@hotmail.com","r3073b71j7" SQL Output INSERT INTO MY_TABLE ("name", "username", "email", "password") VALUES ('Yuki Osinski Hagenes', 'billie.collins', 'frankie.lindgren@hotmail.com', 'def314ac7w9'), ('Kenny Kessler Rice V', 'minh.schneider', 'emilio.tremblay@hotmail.com', '1ij8xjive6'), ('Cory Tromp Konopelski', 'yuko.russel', 'tamar.zboncak@yahoo.com', 'h94nbfv99'), ('Lonna Borer Casper', 'joyce.mclaughlin', 'christen.barton@yahoo.com', '33sopr94vg'), ('Mr. Sammy Braun Langworth', 'darren.osinski', 'verla.hammes@yahoo.com', '39j16kik8');
19. Real Life Usage
20. Real Life Usage Tool To randomize meaningful data in the Factory Test Data Factory Factory Factory Pattern to generate different data scenarios Model Model object using the Build pattern to hold data
21. Real Life Usage public final class UserDataFactory { private static final Faker FAKER = new Faker(); public static User validUser() { return User.builder() .name(FAKER.name().nameWithMiddle()) .username(FAKER.internet().username()) .email(FAKER.internet().emailAddress()) .password(FAKER.internet().password()) .build(); } }
22. Real Life Usage public final class UserDataFactory { private static final Faker FAKER = new Faker(); public static User passwordNotMatchMinRequirement() { return User.builder() .name(FAKER.name().nameWithMiddle()) .username(FAKER.internet().username()) .email(FAKER.internet().emailAddress()) .password(FAKER.internet().password(1,11)) .build(); } }
23. How to Create Yours
24. How To Create Yours [private] Step 1 Create the YAML file with data Step 2 Create the Provider class Step 3 Create the Custom Faker
25. How To Create Yours [private] Step 1 Create an yml file in the src/main/resources en: faker: java-conferences: names: - "Devoxx UK" - "DevNexus" - "Devoxx Belgium" - "JavaZone" - "Jfall" - "Jfokus" - "JavaLand" - "JNation" - "JPrime" - "JCON" en is the locale faker is the reference for the generation java-conferences is the provider key names is the list of values
26. How To Create Yours [private] Step 2 Create the provider class public class JavaConferences extends AbstractProvider<BaseProviders> { protected JavaConferences(BaseProviders faker) { super(faker); faker.addPath(Locale.ENGLISH, Paths.get( getClass().getClassLoader().getResource("java-conferences.yml").getPath())); } public String name() { return resolve("java-conferences.names"); } } The constructor make the connection between the class and the YML file
27. public class JavaConferences extends AbstractProvider<BaseProviders> { protected JavaConferences(BaseProviders faker) { super(faker); faker.addPath(Locale.ENGLISH, Paths.get( getClass().getClassLoader().getResource("java-conferences.yml").getPath())); } public String name() { return resolve("java-conferences.names"); } } How To Create Yours [private] Step 2 Create the provider class Then we use the provider key followed by the generators which will return one of the data present in the YML file
28. How To Create Yours [private] Step 3 Create the custom Faker public class MyCustomFaker extends Faker { public JavaConferences javaConferences() { return getProvider(JavaConferences.class, JavaConferences::new, this); } }
29. How To Create Yours [private] Usage Use the custom faker to generate your private data @Test @DisplayName("Should generate a Java event") void generateJavaEvent() { var javaEvent = myCustomFaker.javaConferences().name(); var country = myCustomFaker.country().name(); LOGGER.info(javaEvent); LOGGER.info(country); assertThat(javaEvent).isNotEmpty(); assertThat(country).isNotEmpty(); }
30. How To Move Yours to DataFaker Step 1 Create the YAML file with data Step 2 Create the Provider class Step 3 Add the yaml file to the service file Step 4 Add it to the BaseProviders
31. How To Move Yours to DataFaker Step 1 Create an yml file in the src/main/resources en: faker: java-conferences: names: - "Devoxx UK" - "DevNexus" - "Devoxx Belgium" - "JavaZone" - "Jfall" - "Jfokus" - "JavaLand" - "JNation" - "JPrime" - "JCON" en is the locale faker is the reference for the generation java-conferences is the provider key names is the list of values
32. How To Move Yours to DataFaker Step 2 Create the provider class in the src/main/java/net.datafaker.providers.base public class JavaConferences extends AbstractProvider<BaseProviders> { protected JavaConferences(BaseProviders faker) { super(faker); } public String name() { return resolve("java-conferences.names"); } } The constructor make the connection between the class and the YML file
33. How To Move Yours to DataFaker Step 2 public class JavaConferences extends AbstractProvider<BaseProviders> { protected JavaConferences(BaseProviders faker) { super(faker); } public String name() { return resolve("java-conferences.names"); } } Then we use the provider key followed by the generators which will return one of the data present in the YML file Create the provider class in the src/main/java/net.datafaker.providers.base
34. How To Move Yours to DataFaker Step 3 Add the YML file name in the src/main/java/net.datafaker.service.files public class EnFile { // previous code ignored private static final List<EnFile> FILES = Stream.of( "address.yml", "Ancient.yml", "YOUR_FILE.yml", ).map(EnFile::new).toList();
35. How To Move Yours to DataFaker Step 4 Add the YML file name in the src/main/java/net.datafaker.providers.base public interface BaseProviders extends ProviderRegistration { default Address address() { return getProvider(Address.class, Address::new); } default JavaConferences javaConferences() { return getProvider(JavaConferences.class, JavaConferences::new); } }
36. Thanks! Elias Nogueira