Human Generated Data

Title

Untitled (Genest's Bread employees standing and sitting in front of building)

Date

c.1937

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4014

Human Generated Data

Title

Untitled (Genest's Bread employees standing and sitting in front of building)

People

Artist: Durette Studio, American 20th century

Date

c.1937

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Human 98.6
Person 98.6
Person 98.6
Person 98.4
Person 98.2
Person 98
Clothing 96.7
Apparel 96.7
Person 96
Person 95
Person 95
Person 94
Person 93.4
Person 92.3
Person 88.4
Person 86.8
People 85.6
Person 84.7
Person 83.8
Person 82.5
Shorts 82.3
Person 77.5
Person 75.6
Crowd 72.8
Female 72.7
Overcoat 72.2
Suit 72.2
Coat 72.2
Person 69.7
Footwear 68.8
Shoe 68.8
Person 64.4
Girl 61.7
Person 58.4
Family 55.3

Clarifai
created on 2019-06-01

chair 96.7
many 95.4
people 95.3
seat 93.6
group together 92.8
house 91.9
crowd 91.1
furniture 90.4
row 88.6
architecture 88.4
group 87.7
room 86.9
building 86.5
horizontal plane 84.8
no person 84.4
audience 83.9
administration 83.3
bench 82.4
empty 81.3
snow 80

Imagga
created on 2019-06-01

classroom 36.5
room 32
picket fence 30.6
balcony 30.3
building 30.2
structure 27.6
graffito 27.5
fence 26.8
architecture 26.5
barrier 20.4
city 19.9
decoration 19
old 17.4
travel 16.9
house 13.4
university 13
scene 13
obstruction 12.4
urban 12.2
night 11.5
snow 11.4
wall 11.3
home 11.2
construction 11.1
sky 10.8
tourism 10.7
park 10.7
outdoor 10.7
trees 10.7
bridge 10.4
winter 10.2
historic 10.1
water 10
tree 10
history 9.8
outdoors 9.7
window 9.6
street 9.2
wood 9.2
business 9.1
light 8.7
summer 8.4
exterior 8.3
school 8.2
tourist 8.2
transportation 8.1
river 8
rural 7.9
design 7.9
residence 7.8
railing 7.7
cold 7.7
palace 7.7
outside 7.7
landscape 7.4
people 7.2
sun 7.2
landmark 7.2
grass 7.1

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

building 99.1
outdoor 94.4
person 86.7
white 67.1

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Happy 49.8%
Calm 49.7%
Angry 49.6%
Surprised 49.5%
Disgusted 49.7%
Confused 49.6%
Sad 49.6%

AWS Rekognition

Age 35-52
Gender Female, 50%
Angry 49.6%
Happy 49.5%
Confused 49.5%
Sad 49.6%
Calm 49.9%
Surprised 49.5%
Disgusted 49.8%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Angry 49.6%
Calm 49.7%
Sad 49.6%
Surprised 49.6%
Disgusted 49.5%
Happy 49.9%
Confused 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Surprised 49.5%
Disgusted 49.5%
Calm 50.1%
Happy 49.8%
Sad 49.6%
Angry 49.5%
Confused 49.5%

AWS Rekognition

Age 35-52
Gender Female, 50.4%
Disgusted 49.5%
Sad 49.9%
Surprised 49.5%
Happy 49.7%
Angry 49.5%
Calm 49.9%
Confused 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.1%
Sad 49.7%
Angry 49.6%
Disgusted 49.6%
Surprised 49.6%
Happy 49.7%
Calm 49.8%
Confused 49.6%

AWS Rekognition

Age 17-27
Gender Female, 50.4%
Confused 49.5%
Happy 50.1%
Calm 49.5%
Disgusted 49.6%
Sad 49.7%
Angry 49.6%
Surprised 49.6%

AWS Rekognition

Age 48-68
Gender Male, 50.4%
Angry 49.6%
Sad 49.9%
Happy 49.5%
Confused 49.6%
Surprised 49.5%
Calm 49.8%
Disgusted 49.6%

AWS Rekognition

Age 16-27
Gender Female, 50.1%
Happy 49.8%
Disgusted 49.6%
Angry 49.6%
Surprised 49.6%
Sad 49.7%
Calm 49.7%
Confused 49.6%

AWS Rekognition

Age 48-68
Gender Female, 50.5%
Confused 49.6%
Angry 49.5%
Sad 49.9%
Calm 49.8%
Disgusted 49.5%
Happy 49.6%
Surprised 49.6%

AWS Rekognition

Age 23-38
Gender Male, 50%
Happy 49.6%
Disgusted 49.9%
Angry 49.6%
Calm 49.6%
Surprised 49.6%
Confused 49.6%
Sad 49.7%

AWS Rekognition

Age 11-18
Gender Male, 50.3%
Happy 49.5%
Disgusted 49.7%
Angry 49.7%
Calm 49.7%
Sad 49.6%
Confused 49.6%
Surprised 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Sad 49.8%
Angry 49.7%
Disgusted 49.6%
Surprised 49.6%
Happy 49.6%
Calm 49.6%
Confused 49.6%

AWS Rekognition

Age 20-38
Gender Female, 50.3%
Disgusted 49.6%
Calm 50%
Surprised 49.6%
Angry 49.6%
Happy 49.5%
Sad 49.6%
Confused 49.6%

AWS Rekognition

Age 23-38
Gender Female, 50.3%
Surprised 49.6%
Sad 49.7%
Angry 49.6%
Disgusted 49.6%
Calm 49.7%
Happy 49.6%
Confused 49.6%

AWS Rekognition

Age 20-38
Gender Female, 50.3%
Angry 49.6%
Happy 49.6%
Confused 49.5%
Calm 49.5%
Surprised 49.5%
Sad 49.5%
Disgusted 50.2%

AWS Rekognition

Age 20-38
Gender Male, 50.1%
Disgusted 49.5%
Surprised 49.5%
Angry 49.5%
Confused 49.5%
Sad 49.5%
Calm 50.3%
Happy 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Disgusted 49.5%
Happy 49.6%
Surprised 49.6%
Sad 49.7%
Angry 49.5%
Confused 49.6%
Calm 49.9%

AWS Rekognition

Age 35-55
Gender Female, 50%
Happy 49.5%
Confused 49.5%
Disgusted 49.5%
Sad 50%
Calm 49.8%
Angry 49.5%
Surprised 49.5%

AWS Rekognition

Age 14-23
Gender Male, 50.5%
Sad 50%
Surprised 49.6%
Disgusted 49.5%
Angry 49.6%
Calm 49.7%
Happy 49.5%
Confused 49.7%

AWS Rekognition

Age 23-38
Gender Female, 50.5%
Confused 49.6%
Calm 49.6%
Sad 50%
Surprised 49.6%
Angry 49.6%
Disgusted 49.6%
Happy 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Surprised 49.5%
Confused 49.6%
Disgusted 49.5%
Happy 49.5%
Sad 49.8%
Calm 50%
Angry 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Disgusted 49.8%
Calm 49.6%
Confused 49.6%
Sad 49.8%
Surprised 49.6%
Angry 49.6%
Happy 49.6%

AWS Rekognition

Age 20-38
Gender Female, 54.9%
Sad 45.3%
Confused 45.1%
Disgusted 45.3%
Surprised 45.5%
Angry 45.3%
Happy 52.8%
Calm 45.6%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Disgusted 49.9%
Happy 49.6%
Surprised 49.6%
Sad 49.6%
Angry 49.7%
Confused 49.5%
Calm 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Disgusted 49.8%
Calm 49.6%
Sad 49.6%
Confused 49.6%
Angry 49.6%
Surprised 49.6%
Happy 49.6%

AWS Rekognition

Age 27-44
Gender Female, 50.2%
Disgusted 49.6%
Calm 49.8%
Surprised 49.6%
Angry 49.7%
Happy 49.7%
Sad 49.6%
Confused 49.6%

AWS Rekognition

Age 20-38
Gender Female, 50.4%
Happy 49.5%
Confused 49.6%
Angry 49.6%
Disgusted 49.5%
Surprised 49.5%
Sad 50.1%
Calm 49.6%

AWS Rekognition

Age 23-38
Gender Female, 50.1%
Happy 49.5%
Disgusted 49.6%
Angry 49.6%
Calm 49.7%
Surprised 49.5%
Confused 49.6%
Sad 50%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Disgusted 49.6%
Sad 49.5%
Happy 49.7%
Surprised 49.6%
Calm 49.7%
Angry 49.8%
Confused 49.6%

AWS Rekognition

Age 23-38
Gender Female, 50.2%
Calm 49.6%
Disgusted 49.5%
Sad 49.6%
Surprised 49.6%
Happy 50.1%
Confused 49.5%
Angry 49.6%

AWS Rekognition

Age 30-47
Gender Female, 50.2%
Angry 49.6%
Happy 49.5%
Sad 49.7%
Disgusted 49.9%
Confused 49.6%
Calm 49.7%
Surprised 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Angry 49.5%
Surprised 49.5%
Disgusted 49.5%
Sad 50.3%
Calm 49.6%
Happy 49.5%
Confused 49.5%

AWS Rekognition

Age 26-44
Gender Female, 50.3%
Angry 49.7%
Calm 49.6%
Sad 50.1%
Surprised 49.5%
Disgusted 49.5%
Happy 49.5%
Confused 49.5%

AWS Rekognition

Age 29-45
Gender Male, 50.1%
Surprised 49.5%
Calm 49.6%
Disgusted 49.8%
Confused 49.5%
Sad 49.9%
Happy 49.5%
Angry 49.6%

AWS Rekognition

Age 26-43
Gender Male, 54.6%
Angry 45.4%
Sad 45.8%
Happy 45.5%
Confused 45.6%
Surprised 45.5%
Calm 48.4%
Disgusted 48.7%

AWS Rekognition

Age 20-38
Gender Female, 50.3%
Happy 49.6%
Confused 49.5%
Angry 49.7%
Disgusted 49.7%
Surprised 49.6%
Sad 49.8%
Calm 49.7%

Feature analysis

Amazon

Person 98.6%
Shoe 68.8%

Captions

Microsoft

a group of people walking in front of a building 91.7%
a group of people standing in front of a building 88.6%
a group of people in front of a building 88.5%

Text analysis

Amazon

BREAD
BETTER
enests BETTER BREAID BETTER BREAD
BETTER BREAID
enests