Human Generated Data

Title

Gene, Marc, Jamie, Rebecca and Lucien, Science
Date

1994
People

Artist: Nicholas Nixon, American born 1947
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of the artist, P2001.149
Copyright

© Nicholas Nixon

Human Generated Data

Title

Gene, Marc, Jamie, Rebecca and Lucien, Science

People

Artist: Nicholas Nixon, American born 1947

Date

1994

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of the artist, P2001.149

Copyright

© Nicholas Nixon

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 99.6
Human 99.6
Person 99.5
Person 98.9
Person 92.6
Text 89.2
Finger 83.8
Sitting 67.1
Classroom 66.7
Indoors 66.7
School 66.7
Room 66.7

Clarifai
created on 2023-10-25

people 99.6
monochrome 98.6
woman 97.5
man 96.8
group 96.6
portrait 96.3
adult 96
street 94.5
girl 93.1
boy 90.5
three 88.7
child 88.2
two 87.6
group together 84.8
indoors 83.5
couple 82.9
room 79.4
actor 78.6
book series 77.7
black and white 76.8

Imagga
created on 2022-01-09

office 57.7
business 49.2
businesswoman 44.6
crossword puzzle 43.2
businessman 36.2
work 34.6
man 34.3
puzzle 34
people 32.9
businesspeople 32.3
corporate 31.8
person 30.7
team 30.5
working 30.1
happy 29.5
laptop 29.4
professional 29.3
desk 29.3
meeting 29.2
computer 28.2
newspaper 28
table 27.7
executive 27
suit 26.9
game 26
teamwork 26
job 25.7
male 24.1
sitting 24.1
successful 23.8
group 23.4
groom 23.4
adult 22.4
manager 22.4
colleagues 22.4
paper 21.2
attractive 21
confident 20.9
success 20.9
communication 20.2
women 17.4
indoor 17.4
product 17.2
looking 16.8
smile 16.4
men 16.3
notebook 16.3
portrait 16.2
finance 16.1
smiling 15.9
document 15.8
together 15.8
workplace 15.3
pen 15.2
education 14.7
two 14.4
student 14.3
career 14.2
indoors 14.1
discussing 13.8
occupation 13.8
lifestyle 13.7
creation 13.5
reading 13.3
partners 12.6
technology 12.6
partner 12.6
partnership 12.5
scholar 12.4
talking 12.4
intellectual 11.9
worker 11.7
discussion 11.7
busy 11.6
collar 11.5
tie 11.4
cheerful 11.4
modern 11.2
company 11.2
secretary 11.1
happiness 11
associates 10.8
corporation 10.6
staff 10.5
boss 10.5
friends 10.3
casual 10.2
phone 10.2
face 10
hand 9.9
interaction 9.9
coworkers 9.8
pretty 9.8
colleague 9.8
contract 9.8
cooperation 9.7
sales 9.6
brunette 9.6
formal 9.6
contemporary 9.4
glasses 9.3
horizontal 9.2
20s 9.2
necktie 9.1
handsome 8.9
explaining 8.9
businesswomen 8.8
businessmen 8.8
consultant 8.8
paperwork 8.8
room 8.6
write 8.5
writing 8.5
showing 8.4
director 8.3
holding 8.3
call 8.2
financial 8
boardroom 7.9
employee 7.9
assistant 7.8
report 7.7
telephone 7.7
expression 7.7
studying 7.7
wireless 7.6
plan 7.6
learning 7.5
camera 7.4
friendly 7.3
school 7.2
information 7.1

Google
created on 2022-01-09

Flash photography 84.6
Black-and-white 84
Style 83.8
Table 83.2
Font 76.6
Monochrome photography 75.1
Monochrome 75.1
Event 71.8
Desk 70.2
Fun 63.8
Stock photography 63.5
Happy 61.6
Room 59.8
Office instrument 56.9
Writing 56.4
Child 54.8
Conversation 53.2
Chair 52.6
Photography 51.6

Microsoft
created on 2022-01-09

person 99.5
human face 97.1
text 96.9
clothing 89.6
handwriting 73.6
black and white 62

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-16
Gender Male, 93.3%
Calm 94.4%
Sad 3.2%
Surprised 1.2%
Angry 0.4%
Fear 0.3%
Disgusted 0.2%
Confused 0.2%
Happy 0.2%

AWS Rekognition

Age 16-22
Gender Female, 99.5%
Calm 95.4%
Sad 1.4%
Happy 1%
Angry 0.6%
Confused 0.5%
Surprised 0.4%
Disgusted 0.3%
Fear 0.3%

AWS Rekognition

Age 13-21
Gender Female, 86.3%
Fear 70.2%
Happy 12.3%
Sad 8.5%
Calm 4.3%
Disgusted 1.4%
Angry 1.3%
Surprised 1.3%
Confused 0.7%

AWS Rekognition

Age 23-33
Gender Female, 100%
Surprised 37.4%
Calm 33.1%
Sad 17.8%
Disgusted 4.1%
Confused 3.3%
Angry 1.5%
Happy 1.5%
Fear 1.3%

Microsoft Cognitive Services

Age 15
Gender Male

Microsoft Cognitive Services

Age 19
Gender Female

Microsoft Cognitive Services

Age 20
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Possible
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Categories

Imagga

paintings art 75.6%
interior objects 10.8%
people portraits 7.5%
pets animals 3.5%
food drinks 1.9%

Captions

Microsoft
created on 2022-01-09

a young girl talking on the phone 26.8%

Text analysis

Amazon

the
READI
300
Small
Catch the war h 300
oo
Catch
conception
war h
LES

Google

09 mally READ Ca e 00
09
mally
READ
Ca
e
00