Human Generated Data

Title

Industrial Problems, Welfare Work: United States. Ohio. Dayton. National Cash Register Company: Welfare Institutions of the National Cash Register Company, Dayton, Ohio.: Departments: Bindery
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.328.B.3

Human Generated Data

Title

Industrial Problems, Welfare Work: United States. Ohio. Dayton. National Cash Register Company: Welfare Institutions of the National Cash Register Company, Dayton, Ohio.: Departments: Bindery

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-06-25

Building 99.6
Factory 99.4
Assembly Line 99.1
Person 99.1
Human 99.1
Person 98.7
Person 98.2
Person 97.5
Person 97.3
Person 96.1
Person 96
Person 94.5
Person 89.5
Person 80
Person 73.3
Person 70.8
Person 69.5
Person 66.1
Person 61.2
Person 56
Person 42.1

Imagga
created on 2022-06-25

cafeteria 100
restaurant 100
building 87.9
structure 60.5
interior 52.2
chair 39.1
table 36.4
room 35.7
furniture 32.6
modern 25.2
inside 23.9
chairs 22.5
design 22
architecture 20.3
indoors 20.2
wood 20
decor 19.5
house 19.2
dining 19
empty 18.9
style 18.6
tables 17.7
floor 17.7
home 17.5
hotel 17.2
indoor 16.4
dinner 16
luxury 15.4
food 15.1
decoration 14.5
drink 14.2
contemporary 14.1
light 14
counter 14
glass 14
urban 14
bar 13.9
hall 12.9
seat 12.8
eat 12.6
comfortable 12.4
lunch 12.2
place 12.1
service 12
window 11.9
lamp 11.4
office 11
business 10.9
nobody 10.9
factory 10.6
plant 10.5
party 10.3
industry 10.3
work 10.2
shop 10.1
city 10
stool 9.9
drawer 9.9
steel 9.7
wooden 9.7
elegance 9.2
classroom 9.2
kitchen 8.9
lifestyle 8.7
scene 8.7
life 8.6
elegant 8.6
decorate 8.6
relax 8.4
coffee 8.3
traditional 8.3
equipment 8.2
stove 7.9
people 7.8
lighting 7.7
wall 7.7
residential 7.7
estate 7.6
lights 7.4
man 7.4
occupation 7.3
island 7.3
reflection 7.3
meal 7.3
industrial 7.3
stylish 7.2
breakfast 7.1
travel 7

Google
created on 2022-06-25

Table 95
Furniture 94
Window 84.7
Chair 79.6
Monochrome photography 71.1
Event 70.9
Monochrome 70.8
Building 70.1
Suit 68.1
Cafeteria 66.9
Room 63.5
History 60.7
Desk 58.9
Recreation 56.6
Restaurant 53.7
Factory 51

Microsoft
created on 2022-06-25

indoor 99.4
table 99
furniture 95.6
library 87.8
chair 86.3
person 86
ceiling 82.8
people 82.4
group 65.4
clothing 63.8
building 61.7
classroom 59.8
desk 58.5
room 41
restaurant 29.3
several 10.1

Face analysis

Amazon

Google

AWS Rekognition

Age 20-28
Gender Male, 60.7%
Calm 89.1%
Sad 7.7%
Surprised 6.4%
Fear 5.9%
Confused 0.3%
Angry 0.3%
Disgusted 0.3%
Happy 0.3%

AWS Rekognition

Age 21-29
Gender Female, 90.5%
Calm 85.9%
Confused 7.1%
Surprised 6.9%
Fear 6%
Sad 2.6%
Happy 2.2%
Disgusted 1.1%
Angry 0.7%

AWS Rekognition

Age 20-28
Gender Female, 99.2%
Surprised 76.7%
Angry 27.9%
Calm 13.9%
Fear 8.1%
Sad 2.9%
Disgusted 2.1%
Confused 1.8%
Happy 1.8%

AWS Rekognition

Age 7-17
Gender Female, 99.9%
Sad 55.1%
Calm 43.1%
Angry 10.6%
Surprised 9%
Fear 8.7%
Confused 3.4%
Disgusted 2.5%
Happy 1.4%

AWS Rekognition

Age 18-24
Gender Female, 81.2%
Sad 99.7%
Calm 15.1%
Disgusted 7.8%
Fear 7.2%
Surprised 6.9%
Angry 1.8%
Confused 1.3%
Happy 0.9%

AWS Rekognition

Age 20-28
Gender Female, 96.8%
Sad 86.1%
Calm 35.9%
Surprised 10.4%
Fear 8.2%
Confused 5.7%
Angry 5.4%
Disgusted 1%
Happy 0.6%

AWS Rekognition

Age 9-17
Gender Female, 76.4%
Calm 50.4%
Confused 15.1%
Sad 14.7%
Angry 9.3%
Surprised 8.2%
Fear 6.7%
Disgusted 3.3%
Happy 1.9%

AWS Rekognition

Age 16-24
Gender Male, 61.9%
Calm 75.6%
Sad 15.6%
Surprised 6.7%
Fear 6.2%
Angry 3%
Disgusted 2.3%
Confused 1.4%
Happy 1%

AWS Rekognition

Age 18-24
Gender Male, 79.8%
Fear 69.8%
Sad 16.6%
Surprised 11.5%
Happy 9.2%
Calm 9.2%
Disgusted 2%
Angry 1.8%
Confused 0.8%

AWS Rekognition

Age 4-10
Gender Female, 58.6%
Sad 97.5%
Happy 18.3%
Calm 15.6%
Fear 8.7%
Surprised 7.5%
Angry 2.1%
Disgusted 1.9%
Confused 1.3%

AWS Rekognition

Age 21-29
Gender Male, 73.4%
Calm 83.4%
Surprised 9.4%
Fear 7.5%
Sad 4.3%
Disgusted 0.9%
Angry 0.8%
Confused 0.6%
Happy 0.4%

AWS Rekognition

Age 18-24
Gender Male, 97.6%
Calm 86.8%
Surprised 6.4%
Fear 5.9%
Sad 5.7%
Confused 3.5%
Angry 1.6%
Happy 0.5%
Disgusted 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%

Captions

Microsoft

a group of people in a room 97.2%
a group of people standing in a room 95.5%
a group of people sitting at a table 85.5%