Human Generated Data

Title

Untitled (men wearing name tags gathered around table)
Date

1959
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17767

Human Generated Data

Title

Untitled (men wearing name tags gathered around table)

People

Artist: Lucian and Mary Brown, American

Date

1959

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17767

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 98.9
Human 98.9
Person 98.3
Person 97.9
Person 97.8
Person 97.7
Person 97.4
Person 96.9
Person 96.8
Person 95.5
Person 95
Person 94.2
Person 91.5
Clinic 89
Tie 87.3
Accessories 87.3
Accessory 87.3
Crowd 85.2
Tie 79.6
Clothing 79.1
Apparel 79.1
Sunglasses 71.8
Hospital 56.2

Clarifai
created on 2023-10-29

people 99.4
group 98.6
man 97.7
adult 97.3
monochrome 97
league 96.6
group together 94
woman 92.7
chair 90.6
indoors 90.3
meeting 88.1
table 86.7
room 85.4
leader 85.4
many 84.8
education 84.5
furniture 83
sit 78.8
actor 77.6
business 75.8

Imagga
created on 2022-02-26

lab coat 72.2
coat 69.2
specialist 59
man 44.4
doctor 37.6
male 37.6
professional 36
medical 35.3
person 33.8
people 30.7
hospital 28.5
businessman 26.5
garment 26.1
work 25.9
business 25.5
adult 24
medicine 23.8
health 23.6
job 23
looking 22.4
office 21.7
team 21.5
laboratory 21.2
patient 20.9
happy 20.7
lab 20.4
clinic 20.4
occupation 20.2
surgeon 20.2
mature 19.5
men 18.9
smiling 18.8
clothing 18.3
care 18.1
colleagues 17.5
worker 17.1
face 17.1
profession 16.3
serious 16.2
working 15.9
teamwork 15.8
scientist 15.7
uniform 15.2
businesspeople 15.2
technology 14.8
practitioner 14.8
stethoscope 14.6
chemistry 14.5
bright 14.3
research 14.3
science 14.2
portrait 13.6
smile 13.5
senior 13.1
group 12.9
indoor 12.8
nurse 12.8
casual 12.7
middle aged 12.7
assistant 12.6
illness 12.4
biology 12.3
indoors 12.3
desk 12.3
education 12.1
table 12.1
sitting 12
computer 12
two 11.9
confident 11.8
clinical 11.7
chemical 11.7
busy 11.6
elderly 11.5
glasses 11.1
treatment 11
room 10.9
doctors 10.8
suit 10.8
student 10.8
40s 10.7
handsome 10.7
expertise 10.7
30s 10.6
human 10.5
corporate 10.3
day 10.2
associates 9.8
mid adult 9.7
together 9.6
test 9.6
exam 9.6
standing 9.6
building 9.5
development 9.5
light 9.4
executive 9.3
study 9.3
company 9.3
20s 9.2
color 8.9
case 8.8
look 8.8
thoughtful 8.7
couple 8.7
chart 8.6
stage 8.4
attractive 8.4
manager 8.4
successful 8.2
friendly 8.2
laptop 8.2
equipment 8.1
cheerful 8.1
healing 7.8
pensive 7.8
experiment 7.8
examination 7.8
scientific 7.8
concentration 7.7
modern 7.7
engineer 7.7
staff 7.7
pencil 7.6
hand 7.6
plan 7.6
writing 7.5
businesswoman 7.3
success 7.2
lifestyle 7.2

Google
created on 2022-02-26

Table 87.2
Black-and-white 85.3
Style 83.9
Monochrome photography 76.1
Font 75.4
Monochrome 74.8
Event 72.5
Art 67.7
Room 66
Suit 65.9
Pattern 63.7
Stock photography 63.4
Vintage clothing 63
History 62.2
Visual arts 60.6
Team 58.5
Illustration 55.2
Tablecloth 54.7
Ceiling 54.2
Circle 53.6

Microsoft
created on 2022-02-26

text 97.3
person 92.3
black and white 80.5
posing 58.2

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 48-54
Gender Male, 99.6%
Confused 46%
Happy 29.5%
Calm 9.1%
Sad 8.1%
Angry 2.5%
Disgusted 2.2%
Surprised 2%
Fear 0.6%

AWS Rekognition

Age 37-45
Gender Male, 99.3%
Happy 98%
Calm 0.6%
Confused 0.5%
Surprised 0.3%
Fear 0.2%
Disgusted 0.2%
Sad 0.1%
Angry 0.1%

AWS Rekognition

Age 51-59
Gender Male, 99.9%
Happy 88.1%
Calm 6.5%
Surprised 2.1%
Confused 0.8%
Fear 0.7%
Angry 0.6%
Sad 0.6%
Disgusted 0.6%

AWS Rekognition

Age 52-60
Gender Male, 99.5%
Sad 91.9%
Calm 3%
Fear 2%
Surprised 1.4%
Confused 0.8%
Disgusted 0.4%
Angry 0.3%
Happy 0.2%

AWS Rekognition

Age 50-58
Gender Male, 91.8%
Happy 73.2%
Calm 16.6%
Sad 4.8%
Confused 3%
Surprised 1%
Disgusted 0.6%
Angry 0.5%
Fear 0.4%

AWS Rekognition

Age 36-44
Gender Male, 99.3%
Sad 99.8%
Confused 0.1%
Fear 0%
Calm 0%
Disgusted 0%
Angry 0%
Happy 0%
Surprised 0%

AWS Rekognition

Age 48-54
Gender Male, 99.6%
Calm 100%
Confused 0%
Surprised 0%
Sad 0%
Disgusted 0%
Happy 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 49-57
Gender Male, 98.3%
Calm 99.9%
Disgusted 0%
Angry 0%
Sad 0%
Surprised 0%
Confused 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 42-50
Gender Female, 84.1%
Calm 46.9%
Happy 36.9%
Sad 4.8%
Confused 3.8%
Disgusted 2.7%
Surprised 2.1%
Angry 1.7%
Fear 1.1%

AWS Rekognition

Age 43-51
Gender Female, 98.3%
Sad 53%
Calm 38.3%
Surprised 1.9%
Angry 1.8%
Happy 1.8%
Disgusted 1.2%
Confused 1.1%
Fear 0.9%

AWS Rekognition

Age 34-42
Gender Male, 71%
Calm 72.2%
Angry 8.5%
Sad 8.5%
Confused 3.4%
Happy 3.2%
Fear 1.8%
Disgusted 1.7%
Surprised 0.6%

AWS Rekognition

Age 49-57
Gender Male, 87.7%
Calm 84.1%
Happy 11.2%
Sad 1.8%
Angry 0.8%
Surprised 0.6%
Confused 0.5%
Disgusted 0.5%
Fear 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Tie
Sunglasses
Person 98.9%
Person 98.3%
Person 97.9%
Person 97.8%
Person 97.7%
Person 97.4%
Person 96.9%
Person 96.8%
Person 95.5%
Person 95%
Person 94.2%
Person 91.5%
Tie 87.3%
Tie 79.6%
Sunglasses 71.8%

Categories

Imagga

streetview architecture 61.3%
paintings art 25.3%
interior objects 11.9%

Text analysis

Amazon

22
STATE
THE
OF
NATIONAL
UNION
F NATIONAL THE UNION STATE OF ILLINOIV
F
ILLINOIV

Google

MJI7--YT 3RA°2--AGO OF ILLINON
MJI7--YT
3RA°2--AGO
OF
ILLINON