Human Generated Data

Title

Untitled (woman and two men at table at party)

Date

c. 1950

People

Artist: John Howell, American active 1930s-1960s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.21563

Human Generated Data

Title

Untitled (woman and two men at table at party)

People

Artist: John Howell, American active 1930s-1960s

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Person 99.8
Human 99.8
Dining Table 99.2
Table 99.2
Furniture 99.2
Person 98.4
Person 97.8
Accessories 96.6
Sunglasses 96.6
Accessory 96.6
Clothing 94.7
Apparel 94.7
Restaurant 93.9
Shirt 90.3
Electronics 86.6
Laptop 86.6
Pc 86.6
Computer 86.6
Meal 85.7
Food 85.7
Glass 83.3
Person 69.6
Dish 69
Pottery 68.1
Indoors 66
Tie 65.4
Overcoat 61.7
Suit 61.7
Coat 61.7
Dining Room 58.9
Room 58.9
Dress Shirt 56.4
Waiter 56.2
Chair 55.7
Tie 50.3

Imagga
created on 2022-03-05

man 49
male 41.8
person 41.3
executive 41.1
office 34.7
people 34.6
businessman 34.4
business 32.2
patient 27.5
meeting 27.3
senior 26.2
adult 25.8
team 25.1
men 24.9
happy 22.6
table 22.5
colleagues 22.3
indoors 22
desk 21.7
smiling 21.7
sitting 21.5
mature 21.4
professional 21.2
businesswoman 20.9
home 19.9
elderly 19.1
talking 19
work 18.8
businesspeople 18
job 17.7
working 17.7
teamwork 17.6
together 17.5
worker 17.2
camera 16.6
couple 16.5
case 16.4
group 16.1
casual 16.1
laptop 15.5
sick person 15.4
suit 15.3
looking 15.2
lab coat 14.8
nurse 14.6
lifestyle 14.5
manager 14
room 13.9
coworkers 13.7
discussing 13.7
corporate 13.7
coat 13.6
discussion 13.6
smile 13.5
day 13.3
medical 13.2
portrait 12.9
40s 12.7
women 12.7
busy 12.5
doctor 12.2
30s 11.5
old 11.1
glasses 11.1
specialist 11
horizontal 10.9
60s 10.7
older 10.7
success 10.5
20s 10.1
successful 10.1
color 10
conference 9.8
cheerful 9.8
half length 9.7
health 9.7
hospital 9.7
computer 9.6
four 9.6
standing 9.6
grandma 9.3
presentation 9.3
communication 9.2
face 9.2
occupation 9.2
indoor 9.1
hand 9.1
confident 9.1
care 9
four people 8.9
associates 8.9
clinic 8.8
grandfather 8.8
casual clothing 8.8
mid adult 8.7
looking camera 8.7
happiness 8.6
bright 8.6
modern 8.4
technology 8.2
clothing 8.1
handsome 8
to 8
facing camera 7.9
paper 7.8
middle aged 7.8
two people 7.8
architect 7.7
project 7.7
retirement 7.7
husband 7.6
serious 7.6
illness 7.6
workplace 7.6
finance 7.6
adults 7.6
plan 7.6
coffee 7.4
inside 7.4
life 7.2
engineer 7.2
interior 7.1

Google
created on 2022-03-05

Photograph 94.1
Black 89.8
Coat 88.4
Black-and-white 85.4
Style 84
Eyewear 82.2
Smile 81.6
T-shirt 78.1
Monochrome photography 75.7
Monochrome 75.7
Tableware 74.6
Snapshot 74.3
White-collar worker 73.7
Event 73
Table 68.3
Stock photography 65.5
Room 64.2
Sitting 64.2
Team 63.7
Crew 62.5

Microsoft
created on 2022-03-05

text 97.8
person 96.4
clothing 94.8
man 91
black and white 81.6
human face 78.9
smile 75.4

Face analysis

Amazon

Google

AWS Rekognition

Age 49-57
Gender Male, 100%
Calm 37.6%
Surprised 25.6%
Sad 23.9%
Happy 4.7%
Confused 3.1%
Fear 2.8%
Disgusted 1.4%
Angry 0.9%

AWS Rekognition

Age 48-56
Gender Male, 97.5%
Happy 67.7%
Surprised 28.4%
Disgusted 1.6%
Confused 0.8%
Calm 0.6%
Angry 0.4%
Sad 0.3%
Fear 0.2%

AWS Rekognition

Age 48-56
Gender Female, 88.4%
Happy 42.5%
Confused 25.5%
Calm 11.4%
Sad 7.3%
Surprised 5%
Disgusted 4.8%
Fear 1.8%
Angry 1.7%

AWS Rekognition

Age 31-41
Gender Male, 99.3%
Calm 82.1%
Surprised 12%
Sad 3.8%
Fear 1%
Confused 0.4%
Disgusted 0.2%
Happy 0.2%
Angry 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Sunglasses 96.6%
Laptop 86.6%
Tie 65.4%

Captions

Microsoft

a group of people posing for a photo 91.5%
a group of men posing for a photo 91.4%
a group of people posing for the camera 91.3%

Text analysis

Amazon

Dr.
Dr. KENNETH
KENNETH
-
- -
S
S MJR
MJR
Hella
MeFARLAND
I
LLAINE
of
MARETT

Google

EAENNETH
EAENNETH