Human Generated Data

Title

Untitled (group portrait of thirteen men posed outdoors in matching suits and corsages)

Date

1945-1955

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9161

Human Generated Data

Title

Untitled (group portrait of thirteen men posed outdoors in matching suits and corsages)

People

Artist: Martin Schweig, American 20th century

Date

1945-1955

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Sailor Suit 99
Human 99
Person 98.7
Person 98.7
Person 98.1
Person 97.4
Person 96.4
Person 96.2
Person 96.1
Military 95.1
Person 94.6
Officer 94.1
Military Uniform 94.1
Person 93.7
Person 92.3
Person 88.7
Person 84.9
Person 83.9
Navy 81.8
Captain 69.8
People 67.9
Person 59.8
Clothing 59.2
Apparel 59.2
Accessory 58.7
Tie 58.7
Accessories 58.7
Person 42.2

Imagga
created on 2022-01-23

nurse 100
doctor 57.3
medical 51.2
hospital 49.2
person 45.3
professional 44
stethoscope 42.7
man 39
medicine 38.7
coat 36.2
health 36.1
uniform 33.6
clinic 33.5
people 31.8
care 31.3
male 29.1
lab coat 27.7
patient 27
occupation 26.6
happy 25.7
smile 25.6
job 24.8
surgeon 24.6
adult 24.4
doctors 23.6
team 23.3
smiling 23.1
confident 22.7
portrait 22
work 22
practitioner 21.9
specialist 21.2
clinical 20.5
worker 19.6
mature 19.5
business 19.4
profession 19.1
physician 18.5
men 18
student 17.7
group 16.9
working 16.8
staff 16.5
healthy 16.4
handsome 16
standing 14.8
golfer 14.6
practice 14.5
laboratory 14.5
looking 14.4
health care 13.6
player 13.4
illness 13.3
friendly 12.8
sick 12.6
businessman 12.4
office 12
treatment 11.9
suit 11.7
success 11.3
teamwork 11.1
clothing 11.1
surgical 10.8
surgery 10.7
consultant 10.7
ill 10.7
contestant 10.6
human 10.5
intern 9.8
old 9.7
women 9.5
happiness 9.4
senior 9.4
two 9.3
black 9
general practitioner 8.9
lab 8.7
colleagues 8.7
expertise 8.7
exam 8.6
confidence 8.6
enrollee 8.4
successful 8.2
garment 8
sick person 7.9
couple 7.8
hands 7.8
examination 7.8
case 7.7
astronaut 7.4
cheerful 7.3
color 7.2
bright 7.1
face 7.1

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

person 99
posing 96.9
text 96.7
outdoor 95.8
clothing 88.1
standing 85.3
old 83
white 80.5
man 78
black 77.4
group 63.6
black and white 60.4
team 25.5

Face analysis

Amazon

Google

AWS Rekognition

Age 23-33
Gender Female, 96.1%
Calm 92.9%
Sad 4.5%
Angry 1.2%
Surprised 0.5%
Disgusted 0.3%
Happy 0.2%
Confused 0.2%
Fear 0.2%

AWS Rekognition

Age 27-37
Gender Male, 88%
Calm 99.8%
Surprised 0.1%
Disgusted 0%
Angry 0%
Happy 0%
Fear 0%
Confused 0%
Sad 0%

AWS Rekognition

Age 29-39
Gender Female, 94.6%
Happy 89.2%
Surprised 3.7%
Calm 3.1%
Fear 1.9%
Confused 1%
Sad 0.5%
Disgusted 0.3%
Angry 0.2%

AWS Rekognition

Age 20-28
Gender Female, 95.4%
Calm 94.8%
Disgusted 2.2%
Confused 0.9%
Fear 0.7%
Happy 0.6%
Surprised 0.4%
Angry 0.2%
Sad 0.1%

AWS Rekognition

Age 33-41
Gender Male, 95.6%
Calm 64.8%
Happy 12.1%
Fear 7.9%
Sad 7.1%
Confused 3.1%
Surprised 2.7%
Disgusted 1.3%
Angry 0.9%

AWS Rekognition

Age 22-30
Gender Female, 95.4%
Calm 99%
Surprised 0.4%
Confused 0.3%
Disgusted 0.1%
Fear 0.1%
Happy 0.1%
Sad 0%
Angry 0%

AWS Rekognition

Age 33-41
Gender Male, 89.4%
Calm 49.3%
Disgusted 39.3%
Sad 5.1%
Angry 2.6%
Happy 1.1%
Confused 1%
Surprised 1%
Fear 0.7%

AWS Rekognition

Age 33-41
Gender Female, 88.5%
Fear 55.3%
Calm 38.5%
Sad 2.1%
Happy 1.5%
Surprised 1.4%
Disgusted 0.6%
Confused 0.4%
Angry 0.3%

AWS Rekognition

Age 43-51
Gender Female, 99.7%
Calm 53.6%
Happy 34.4%
Sad 5.2%
Confused 1.8%
Disgusted 1.8%
Fear 1.2%
Angry 1.2%
Surprised 0.7%

AWS Rekognition

Age 25-35
Gender Male, 96.6%
Calm 99.3%
Happy 0.6%
Confused 0%
Disgusted 0%
Surprised 0%
Fear 0%
Sad 0%
Angry 0%

AWS Rekognition

Age 36-44
Gender Female, 71.6%
Calm 98.3%
Happy 0.4%
Surprised 0.3%
Disgusted 0.3%
Confused 0.3%
Fear 0.1%
Sad 0.1%
Angry 0.1%

AWS Rekognition

Age 45-53
Gender Male, 80.5%
Calm 95.9%
Surprised 3.2%
Happy 0.7%
Angry 0.1%
Disgusted 0.1%
Sad 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 36-44
Gender Female, 95.1%
Calm 63.5%
Happy 24.2%
Fear 6.9%
Sad 2.1%
Surprised 1.2%
Confused 1%
Disgusted 0.9%
Angry 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%
Tie 58.7%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 97.4%
a vintage photo of a group of people posing for a picture 97.3%
a group of people posing for a photo 97.2%

Text analysis

Amazon

# &
n
80s

Google

YT3RA2-AA
80
80 YT3RA2-AA