Human Generated Data

Title

Untitled (couple sitting with man at a bar)
Date

1949
People

Artist: Orrion Barger, American active 1913 - 1984
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6231

Human Generated Data

Title

Untitled (couple sitting with man at a bar)

People

Artist: Orrion Barger, American active 1913 - 1984

Date

1949

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.7
Human 99.7
Person 99.5
Person 99.2
Person 98.9
Person 98.8
Person 96.7
Person 95.8
Person 95
Clothing 94.8
Apparel 94.8
Person 89.9
Shirt 89.8
Person 84.4
Sitting 83.5
Meal 68.3
Food 68.3
Finger 68.1
Crowd 65
Tie 62.6
Accessories 62.6
Accessory 62.6
Dress Shirt 61.1
Person 60.3
Coat 58.7
Suit 58.2
Overcoat 58.2
Text 56.5

Imagga
created on 2022-01-22

man 42.3
senior 39.4
nurse 38.7
male 34
indoors 33.4
home 32.7
person 31.1
people 30.7
mature 27
adult 26.4
specialist 25.9
elderly 23.9
smiling 23.9
couple 22.7
sitting 22.3
grandma 21.9
happy 21.3
patient 19.8
medical 19.4
office 19.4
lab coat 19.1
lifestyle 18.1
camera 17.6
men 17.2
casual 16.9
looking 16.8
old 16.7
professional 16.7
business 16.4
coat 16.2
businessman 15.9
together 15.8
health 15.3
businesspeople 15.2
doctor 15
clinic 15
day 14.9
portrait 14.9
room 14.8
retired 14.5
computer 14.4
talking 14.3
hospital 14.2
70s 13.8
laptop 13.7
older 13.6
working 13.3
practitioner 13.2
care 13.2
inside 12.9
colleagues 12.6
30s 12.5
retirement 12.5
desk 12.3
meeting 12.2
table 12.1
women 11.9
work 11.8
happiness 11.8
60s 11.7
bartender 11.7
worker 11.7
40s 11.7
two people 11.7
husband 11.5
cheerful 11.4
businesswoman 10.9
horizontal 10.9
aged 10.9
family 10.7
clothing 10.7
to 10.6
color 10.6
illness 10.5
indoor 10
smile 10
face 9.9
senior adult 9.9
team 9.9
gray hair 9.9
casual clothing 9.8
mid adult 9.6
wife 9.5
occupation 9.2
holding 9.1
half length 8.8
thirties 8.8
groom 8.7
four 8.6
drinking 8.6
bright 8.6
age 8.6
enjoying 8.5
grandfather 8.5
modern 8.4
case 8.4
drink 8.4
glasses 8.3
20s 8.2
group 8.1
handsome 8
job 8
facing camera 7.9
seniors 7.9
forties 7.8
middle aged 7.8
exam 7.7
two 7.6
shirt 7.5
teamwork 7.4
mother 7.2
suit 7.2
stethoscope 7.2
kitchen 7.2
look 7

Google
created on 2022-01-22

Shirt 93.9
Coat 89.4
Black-and-white 83.9
Hat 81.3
Font 78.9
Monochrome photography 72.6
Glass 72.5
Barware 71.9
Event 70.7
Monochrome 70
Cooking 69.8
Vintage clothing 69.3
Suit 63.9
Stock photography 63
Room 61.4
History 61.3
Art 58.4
T-shirt 56
Uniform 56

Microsoft
created on 2022-01-22

person 99.8
clothing 91.7
human face 75.6
man 68.8
black and white 56.8
people 55.4

Face analysis

Amazon

Google

AWS Rekognition

Age 50-58
Gender Male, 95.3%
Calm 99.9%
Sad 0%
Angry 0%
Happy 0%
Surprised 0%
Disgusted 0%
Fear 0%
Confused 0%

AWS Rekognition

Age 24-34
Gender Male, 89.5%
Calm 99.5%
Surprised 0.1%
Angry 0.1%
Sad 0.1%
Disgusted 0.1%
Confused 0.1%
Fear 0%
Happy 0%

AWS Rekognition

Age 27-37
Gender Female, 98.2%
Calm 99%
Sad 0.6%
Happy 0.2%
Confused 0.1%
Surprised 0%
Angry 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 23-33
Gender Female, 85.3%
Calm 38.3%
Sad 26.5%
Happy 24.8%
Confused 6.8%
Disgusted 1.2%
Angry 1%
Surprised 0.8%
Fear 0.7%

AWS Rekognition

Age 23-31
Gender Female, 91.9%
Calm 37%
Fear 15.6%
Sad 14.1%
Happy 11.7%
Angry 7.8%
Disgusted 5.1%
Surprised 4.8%
Confused 4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Person 99.7%
Tie 62.6%

Captions

Microsoft

a group of people standing in front of a window 92.7%
a group of people standing in front of a mirror 91%
a group of people standing in front of a mirror posing for the camera 85.4%

Text analysis

Amazon

ING
SODA
PRIMG
RUS

Google

RING
RING