Human Generated Data

Title

Untitled (man sitting behind desk)

Date

1952

People

Artist: Peter James Studio, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.20059

Human Generated Data

Title

Untitled (man sitting behind desk)

People

Artist: Peter James Studio, American

Date

1952

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Person 99.7
Human 99.7
Sitting 97.2
Crowd 60.8
Face 59.4
Furniture 58.9
Meal 58.3
Food 58.3
Clothing 57.5
Suit 57.5
Coat 57.5
Apparel 57.5
Overcoat 57.5
Finger 56.2
Spoke 55.6
Machine 55.6

Imagga
created on 2022-03-05

man 43.1
male 33.4
person 33.2
business 29.8
office 29.6
people 27.9
adult 27.6
businessman 27.4
laptop 26.6
happy 26.3
sitting 24.9
smiling 21
computer 21
table 20.7
professional 20.4
executive 19.2
home 19.1
desk 18.9
indoors 18.4
work 18.1
corporate 18
senior 17.8
cheerful 17.1
suit 16.5
colleagues 16.5
businesswoman 16.4
casual 16.1
working 15.9
room 15.4
team 15.2
looking 15.2
lifestyle 15.2
meeting 15.1
men 14.6
group 14.5
handsome 14.3
businesspeople 14.2
mature 13.9
worker 13.9
kitchen 13
smile 12.8
technology 12.6
talking 12.4
portrait 12.3
20s 11.9
happiness 11.8
30s 11.5
job 11.5
together 11.4
couple 11.3
teamwork 11.1
women 11.1
indoor 11
coworkers 10.8
clothing 10.3
occupation 10.1
communication 10.1
successful 10.1
attractive 9.8
lab coat 9.8
classroom 9.7
teacher 9.7
food 9.7
elderly 9.6
color 9.5
waiter 9.4
camera 9.2
coat 9.1
musical instrument 9.1
modern 9.1
standing 8.7
mid adult 8.7
busy 8.7
education 8.7
day 8.6
staff 8.6
workplace 8.6
face 8.5
adults 8.5
life 8.5
keyboard 8.4
manager 8.4
horizontal 8.4
house 8.4
glasses 8.3
one 8.2
confident 8.2
success 8
notebook 8
interior 8
associates 7.9
30 35 years 7.9
discussion 7.8
couch 7.7
leader 7.7
using 7.7
expression 7.7
student 7.6
tie 7.6
shirt 7.5
company 7.4
counter 7.4
speaker 7.4

Google
created on 2022-03-05

Desk 85.2
Curtain 83
Black-and-white 82.3
Table 78.3
Monochrome photography 73.9
Monochrome 73.2
Writing desk 70.1
Countertop 68.2
Rectangle 67
Glass 66.3
Cooking 65.1
Room 64.6
Event 64.3
Sitting 62.3
Tableware 61.6
Metal 59.3
Font 58.8
Kitchen 56.3
Serveware 53
Office equipment 52.9

Microsoft
created on 2022-03-05

person 96
indoor 90.2
man 90
text 83.5
dish 80.1
clothing 78.9
table 60.8
human face 55.2
bottle 51

Face analysis

Amazon

Google

AWS Rekognition

Age 56-64
Gender Male, 99.1%
Confused 57.8%
Happy 17%
Surprised 10.6%
Sad 5.4%
Calm 3.8%
Angry 2.8%
Disgusted 1.7%
Fear 0.9%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a man standing in front of a counter 93.6%
a man standing in front of a table 93.2%
a man standing in front of a window 84%