Human Generated Data

Title

Untitled (advertising executives on "White Tower" account)

Date

1951

People

Artist: Peter James Studio, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.20116

Human Generated Data

Title

Untitled (advertising executives on "White Tower" account)

People

Artist: Peter James Studio, American

Date

1951

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Restaurant 99.8
Person 99.5
Human 99.5
Person 98.9
Cafe 96.9
Person 96.1
Chair 95.9
Furniture 95.9
Person 95.6
Cafeteria 94.9
Person 90
Chair 88.1
Food 79.7
Meal 79.7
Sitting 77.4
Food Court 72.3
Chair 51.9
Person 42.5

Imagga
created on 2022-03-05

man 39
people 35.1
male 32.6
person 32.5
office 25.3
adult 21.4
work 21.2
medical 21.2
professional 20.4
job 20.3
business 20
men 19.7
smiling 19.5
working 19.4
doctor 18.8
room 18
coat 17.7
indoors 17.6
patient 17.3
worker 17.3
senior 16.9
computer 16.9
specialist 16.4
home 15.9
businessman 15.9
happy 15.7
team 15.2
sitting 14.6
meeting 14.1
medicine 14.1
education 13.8
nurse 13.8
group 13.7
desk 13.6
hospital 13.5
table 13.3
health 13.2
lifestyle 13
surgeon 12.9
lab coat 12.9
occupation 12.8
businesswoman 12.7
technology 12.6
laboratory 12.5
teamwork 12
women 11.9
lab 11.7
colleagues 11.7
portrait 11.6
couple 11.3
modern 11.2
laptop 11.1
care 10.7
smile 10.7
chemistry 10.6
together 10.5
uniform 10.5
equipment 10.4
corporate 10.3
mature 10.2
indoor 10
classroom 9.8
kitchen 9.8
scientist 9.8
case 9.7
teacher 9.6
biology 9.5
study 9.3
student 9.3
suit 9
to 8.8
interior 8.8
looking 8.8
conference 8.8
clinic 8.7
research 8.6
businesspeople 8.5
shop 8.4
hand 8.4
science 8
executive 7.8
concentration 7.7
test 7.7
exam 7.7
serious 7.6
illness 7.6
college 7.6
restaurant 7.6
communication 7.6
horizontal 7.5
house 7.5
human 7.5
manager 7.4
holding 7.4
focus 7.4
board 7.2
television camera 7.2
bright 7.1
life 7.1
instrument 7

Google
created on 2022-03-05

Black 89.6
Black-and-white 84.1
Table 81.1
Snapshot 74.3
Monochrome 73.8
Monochrome photography 73.8
Cooking 71.9
Font 70.7
Art 70.1
Vintage clothing 66.7
Room 66.2
Sitting 64.8
Chair 63.7
T-shirt 63.7
Stock photography 63.2
Desk 54.3
Visual arts 53.6
Machine 53.3
Kitchen 53
Tableware 51.8

Microsoft
created on 2022-03-05

text 99.5
indoor 97
clothing 92
person 91
black and white 78.5
man 72.6
table 38.1
worktable 12.5

Face analysis

Amazon

Google

AWS Rekognition

Age 40-48
Gender Male, 86.3%
Calm 99.7%
Sad 0.1%
Happy 0.1%
Surprised 0%
Angry 0%
Disgusted 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 48-54
Gender Male, 99.9%
Calm 99.9%
Happy 0%
Sad 0%
Confused 0%
Disgusted 0%
Angry 0%
Surprised 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Chair 95.9%

Captions

Microsoft

a group of people sitting at a desk 77.2%
a person sitting at a desk in front of a store 68.5%
a group of people sitting at a desk in front of a store 58%

Text analysis

Amazon

Grant
Felix Grant
Felix
PATROL
YAWN
WHITE
100
WWDC
MUSICAL
WROW
GOODMAN
MENU
HWAY
TOWER
WHITE TOWER
TO
ON THE YAWN PATROL
-
MICHAELS
WHITE lower
MHILE
JORTA9 HWAY
BENNY GOODMAN NITE
NITE
Enjoy -
lower
ON THE
BENNY
JORTA9
Feller
the
Enjoy
Sharm Feller
MHILE LOMEM
100 n115
MON. TO SAX
NEWS
Sharm
CLOUD
كريم СКО MICHAELS
Music
MON.
СКО
LOMEM
SAX
RCOP
Wen
كريم
n115
R
-RAZIO
المملكة
D3

Google

MENU
WHITE
TOWER
Felix
BRNY
IOWER
Grant
YAWN
MON.TO
100
GEO
MICHAELS
PATROL
GOODMAN
E
200-6BRAM
18
MUSICAL
J00154
SAT
WHITE IOWER MUSICAL MENU GEO MICHAELS WROW WHITE IOWER WHITE TOWER Felix Grant YAWN PATROL J00154 Sfiller NEWS BRNY GOODMAN E MON.TO SAT WWDC 200-6BRAM 100 18
WROW
Sfiller
NEWS
WWDC