Human Generated Data

Title

Untitled (Mask and Wig members reading at table)
Date

1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8365
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (Mask and Wig members reading at table)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 99.3
Human 99.3
Person 99.2
Person 99
Person 99
Person 98.3
Person 97.9
Person 97.1
Person 97
Person 96.6
Person 93.1
Clothing 83.4
Apparel 83.4
Person 77.8
Clinic 72.8
Room 69
Indoors 69
Table 65.1
Furniture 65.1
People 64.6
Sunglasses 63.1
Accessories 63.1
Accessory 63.1
Person 62.1
Face 56.2

Imagga
created on 2022-01-09

people 24.5
iron lung 24.1
respirator 19.3
man 18.2
person 17.9
shop 17.4
device 16.6
pillory 15.4
male 14.9
business 14.6
breathing device 14.5
team 14.3
mercantile establishment 13.9
instrument 13.2
instrument of punishment 13
old 12.5
student 12.3
blackboard 12.2
education 12.1
group 12.1
room 11.5
businessman 11.5
men 11.1
black 10.8
art 10.6
work 10.2
happy 10
adult 10
city 10
design 9.6
classroom 9.5
barbershop 9.4
grunge 9.4
school 9.3
place of business 9.2
hand 9.1
case 8.9
symbol 8.7
teacher 8.7
class 8.7
two 8.5
modern 8.4
vintage 8.3
toyshop 8.2
retro 8.2
technology 8.2
aged 8.1
drawing 8.1
success 8
looking 8
working 7.9
world 7.8
antique 7.8
portrait 7.8
building 7.6
sign 7.5
senior 7.5
office 7.4
job 7.1
nurse 7
architecture 7

Google
created on 2022-01-09

Art 82.8
Cooking 76.5
Snapshot 74.3
Room 73.5
Event 72.3
Machine 66
Vintage clothing 65.5
Photo caption 64
Team 64
Stock photography 63
History 61.7
T-shirt 60.5
Illustration 56.6
Countertop 54.6
Chef 54.5
Font 53.9
Monochrome 53.8
Cook 53.6
Fast food 53.4
Service 52.5

Microsoft
created on 2022-01-09

text 98.6
person 89.5
table 70.8
clothing 65.3
furniture 57.1

Face analysis

Amazon

Google

AWS Rekognition

Age 36-44
Gender Male, 76.9%
Calm 96.6%
Sad 1.4%
Surprised 0.9%
Disgusted 0.4%
Happy 0.3%
Angry 0.2%
Confused 0.2%
Fear 0.1%

AWS Rekognition

Age 19-27
Gender Male, 99.7%
Calm 100%
Surprised 0%
Sad 0%
Happy 0%
Confused 0%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 27-37
Gender Male, 93.9%
Calm 95.7%
Sad 3.7%
Happy 0.3%
Surprised 0.2%
Confused 0%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 23-33
Gender Female, 82%
Calm 89.5%
Surprised 7.4%
Happy 2%
Disgusted 0.3%
Sad 0.2%
Angry 0.2%
Fear 0.2%
Confused 0.2%

AWS Rekognition

Age 22-30
Gender Male, 99.9%
Calm 99.7%
Surprised 0.2%
Sad 0%
Confused 0%
Angry 0%
Disgusted 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 20-28
Gender Male, 88.7%
Calm 99.6%
Happy 0.2%
Surprised 0.1%
Confused 0.1%
Sad 0%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 18-26
Gender Male, 95.6%
Calm 98.6%
Surprised 0.7%
Sad 0.4%
Disgusted 0.1%
Happy 0.1%
Angry 0%
Fear 0%
Confused 0%

AWS Rekognition

Age 23-33
Gender Female, 74.2%
Calm 99.9%
Sad 0%
Surprised 0%
Happy 0%
Confused 0%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 37-45
Gender Male, 97.3%
Calm 63.9%
Sad 34.8%
Angry 0.6%
Confused 0.2%
Disgusted 0.2%
Surprised 0.1%
Happy 0.1%
Fear 0.1%

AWS Rekognition

Age 39-47
Gender Male, 92.5%
Calm 98.9%
Surprised 0.4%
Sad 0.3%
Angry 0.2%
Fear 0.1%
Confused 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 24-34
Gender Male, 99.7%
Calm 99.2%
Sad 0.5%
Surprised 0.2%
Disgusted 0%
Angry 0%
Happy 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 16-22
Gender Female, 89.4%
Calm 83%
Sad 13.1%
Confused 0.8%
Disgusted 0.8%
Happy 0.8%
Fear 0.5%
Surprised 0.5%
Angry 0.4%

AWS Rekognition

Age 48-54
Gender Female, 50.2%
Calm 99.1%
Sad 0.3%
Confused 0.2%
Happy 0.1%
Surprised 0.1%
Disgusted 0.1%
Angry 0.1%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Sunglasses 63.1%

Captions

Microsoft

a group of people performing on a counter 85.2%
a group of people sitting in front of a store 65.2%
a group of people standing in front of a store 65.1%

Text analysis

Amazon

14362
14362.
MENT
Lavino

Google

14362 BAND FMENT inol 14362.
14362
BAND
FMENT
inol
14362.