Human Generated Data

Title

Untitled (group portrait of thirteen men in matching suits looking at one man outdoors)

Date

1949

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9246

Human Generated Data

Title

Untitled (group portrait of thirteen men in matching suits looking at one man outdoors)

People

Artist: Martin Schweig, American 20th century

Date

1949

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 99.2
Sailor Suit 99.2
Person 99
Person 98.8
Person 98.7
Person 98.3
Person 98.2
Person 97.6
Person 97.1
Person 96.6
Person 96.3
Person 94.8
Person 94.3
Military 93.9
Officer 92.4
Military Uniform 92.4
Person 83.4
Apparel 83.4
Clothing 83.4
Navy 77.9
Person 74.9
People 73.8
Shirt 70.5
Person 66.6
Accessory 62.6
Accessories 62.6
Tie 62.6
Captain 59

Imagga
created on 2022-01-23

nurse 60
person 41.6
man 35.6
doctor 31.9
people 31.2
hospital 29.4
medical 29.1
male 28.4
happy 26.3
coat 26.2
professional 25.7
adult 24.5
team 23.3
cricket equipment 22.8
uniform 22.6
health 21.5
smile 21.4
stethoscope 21.3
medicine 21.1
group 20.9
wicket 19.6
smiling 19.5
business 18.8
portrait 18.8
lab coat 18.5
care 18.1
worker 17.8
sports equipment 17.3
standing 16.5
men 16.3
clinic 16.3
patient 15.2
businessman 15
doctors 14.7
occupation 14.7
confident 14.6
work 14.1
mature 13.9
surgeon 13.8
black 13.2
teamwork 13
equipment 13
friendly 12.8
looking 12.8
clinical 12.7
clothing 12.7
staff 12.6
women 12.6
happiness 12.5
job 12.4
suit 11.7
together 11.4
healthy 11.3
two 11
working 10.6
hands 10.4
student 10.2
surgical 9.8
handsome 9.8
stage 9.8
old 9.7
colleagues 9.7
success 9.7
couple 9.6
player 9.3
specialist 9.1
practitioner 9
human 9
cricket bat 8.9
physician 8.8
life 8.7
day 8.6
illness 8.6
casual 8.5
contestant 8.4
hand 8.4
fan 8.3
boy 7.8
face 7.8
40s 7.8
practice 7.7
profession 7.7
adults 7.6
one 7.5
cheerful 7.3
lifestyle 7.2
room 7.2
platform 7.1
family 7.1
garment 7.1

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

person 98.4
text 96.1
posing 92.5
outdoor 92.4
standing 86.2
old 84.6
black and white 75.8
white 75
group 74.6
black 70.2
clothing 70
man 52.5
team 33.7

Face analysis

Amazon

Google

AWS Rekognition

Age 35-43
Gender Female, 72.8%
Calm 99.4%
Happy 0.2%
Sad 0.1%
Disgusted 0.1%
Fear 0.1%
Surprised 0.1%
Confused 0.1%
Angry 0%

AWS Rekognition

Age 38-46
Gender Female, 54.5%
Calm 98.7%
Sad 1%
Confused 0.1%
Disgusted 0%
Surprised 0%
Fear 0%
Angry 0%
Happy 0%

AWS Rekognition

Age 23-33
Gender Female, 80.1%
Calm 99.9%
Disgusted 0%
Surprised 0%
Angry 0%
Happy 0%
Confused 0%
Sad 0%
Fear 0%

AWS Rekognition

Age 20-28
Gender Female, 98.4%
Calm 99.7%
Sad 0.1%
Confused 0%
Surprised 0%
Disgusted 0%
Angry 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 30-40
Gender Female, 99.8%
Calm 83.3%
Surprised 10.7%
Happy 4%
Fear 1.2%
Confused 0.3%
Disgusted 0.2%
Sad 0.2%
Angry 0.1%

AWS Rekognition

Age 36-44
Gender Male, 58.6%
Calm 60.3%
Disgusted 15.2%
Sad 11.4%
Happy 4.7%
Confused 2.4%
Surprised 2.3%
Angry 2.3%
Fear 1.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Tie 62.6%

Captions

Microsoft

a group of people posing for a photo 97.7%
an old photo of a group of people posing for the camera 96.7%
an old photo of a group of people posing for a picture 96.6%

Text analysis

Amazon

80A

Google

804 YT3RA2 XAGUA
804
YT3RA2
XAGUA