Human Generated Data

Title

Untitled (large family portrait in living room)
Date

1964
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17048

Human Generated Data

Title

Untitled (large family portrait in living room)

People

Artist: Lucian and Mary Brown, American

Date

1964

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17048

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 99.5
Human 99.5
Person 99.1
Person 99
Person 98.8
Person 98.3
Person 98.3
Clothing 98.1
Apparel 98.1
Person 97.6
Person 97.2
Person 96.4
Tie 95.3
Accessories 95.3
Accessory 95.3
Furniture 93.8
Face 92.3
Person 90.6
People 84.5
Table 83.7
Chair 83.3
Dress 83.1
Indoors 82
Meal 80.7
Food 80.7
Female 80.1
Suit 79
Coat 79
Overcoat 79
Tie 77.3
Room 76
Lamp 72.5
Dish 71.6
Icing 70.9
Dessert 70.9
Cake 70.9
Cream 70.9
Creme 70.9
Dining Table 70.8
Shirt 69.7
Portrait 69.4
Photography 69.4
Photo 69.4
Table Lamp 64.6
Woman 62.8
Tie 61.1
Gown 59.9
Fashion 59.9
Crowd 58.1
Flower 57
Plant 57
Blossom 57
Girl 55.4
Person 54.1

Clarifai
created on 2023-10-29

people 99.9
group 99.7
adult 98.1
man 98.1
group together 97.9
woman 97.2
education 95.4
medical practitioner 94.6
child 92.1
leader 87.5
meeting 84.6
several 83.6
many 83.4
five 83
actor 82.6
teacher 82.4
monochrome 81.6
three 80.4
indoors 79.7
interaction 77.5

Imagga
created on 2022-02-26

barbershop 39.8
professional 36.1
man 35.6
male 35.5
person 34.6
shop 33
people 32.9
adult 30.1
men 26.6
businessman 26.5
coat 25.8
office 24.2
mercantile establishment 24
medical 23.8
business 23.1
worker 22.6
room 22.3
lab coat 21.2
work 20.4
clinic 20.1
happy 20
indoors 19.3
doctor 18.8
job 18.6
corporate 18
team 17.9
hospital 17.6
couple 17.4
smiling 17.4
indoor 17.3
desk 17
medicine 16.7
group 16.1
place of business 16
table 15.6
colleagues 15.5
clothing 15.5
modern 15.4
patient 15.4
computer 15.2
businesspeople 15.2
handsome 15.2
women 15
smile 15
teacher 14.8
health 14.6
casual 14.4
two 14.4
home 14.4
working 14.1
meeting 14.1
teamwork 13.9
sitting 13.7
mature 13
portrait 12.9
laptop 12.8
businesswoman 12.7
lab 12.6
happiness 12.5
lifestyle 12.3
color 12.2
manager 12.1
occupation 11.9
laboratory 11.6
care 11.5
talking 11.4
together 11.4
life 11.3
looking 11.2
communication 10.9
horizontal 10.9
associates 10.8
nurse 10.6
interior 10.6
hairdresser 10.5
executive 10.3
senior 10.3
20s 10.1
holding 9.9
cheerful 9.8
human 9.7
education 9.5
uniform 9.5
career 9.5
sax 9.4
board 9
suit 9
technology 8.9
success 8.8
coworkers 8.8
practitioner 8.8
scientist 8.8
conference 8.8
discussion 8.8
expertise 8.7
chemical 8.7
test 8.7
profession 8.6
research 8.6
face 8.5
adults 8.5
attractive 8.4
employee 8.2
establishment 8
garment 7.9
day 7.8
casual clothing 7.8
standing 7.8
assistant 7.8
30s 7.7
diversity 7.7
hand 7.6
biology 7.6
tie 7.6
chair 7.6
study 7.5
student 7.4
educator 7.4
wind instrument 7.4
successful 7.3
confident 7.3
stethoscope 7.1

Google
created on 2022-02-26

Outerwear 95.2
Photograph 94.2
Black 89.7
Table 88.6
Black-and-white 87.2
Coat 87.2
Interior design 85.2
Style 84.1
Adaptation 79.2
Suit 78.8
Monochrome 77.6
Monochrome photography 77
Vintage clothing 74.4
Snapshot 74.3
Event 73.6
Chair 70.4
Room 65.4
History 64.1
Stock photography 63
Visual arts 62.7

Microsoft
created on 2022-02-26

text 98.5
person 97.6
clothing 96.4
woman 89.2
man 86.2
table 76.6
black and white 59.5
human face 55.9

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 33-41
Gender Male, 95.3%
Happy 50%
Surprised 46.6%
Calm 1.7%
Fear 0.7%
Disgusted 0.4%
Confused 0.2%
Sad 0.2%
Angry 0.2%

AWS Rekognition

Age 31-41
Gender Male, 99.5%
Surprised 53.7%
Fear 9.4%
Sad 9.4%
Calm 9.3%
Angry 7.6%
Happy 5.4%
Confused 2.8%
Disgusted 2.3%

AWS Rekognition

Age 36-44
Gender Male, 97.5%
Happy 82.9%
Fear 6%
Calm 4.1%
Sad 2.9%
Surprised 2.2%
Angry 0.8%
Disgusted 0.7%
Confused 0.4%

AWS Rekognition

Age 40-48
Gender Female, 99.8%
Calm 99.2%
Sad 0.3%
Happy 0.2%
Surprised 0.1%
Angry 0.1%
Confused 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 35-43
Gender Male, 75.2%
Happy 90.7%
Sad 7.6%
Calm 0.4%
Angry 0.4%
Fear 0.2%
Surprised 0.2%
Disgusted 0.2%
Confused 0.2%

AWS Rekognition

Age 31-41
Gender Male, 99.1%
Happy 83.9%
Surprised 6.4%
Confused 6.2%
Calm 1.9%
Sad 0.6%
Angry 0.4%
Disgusted 0.3%
Fear 0.3%

AWS Rekognition

Age 38-46
Gender Male, 96.8%
Surprised 80.7%
Sad 5.8%
Happy 5.3%
Calm 4.8%
Angry 1%
Fear 0.9%
Disgusted 0.8%
Confused 0.7%

AWS Rekognition

Age 30-40
Gender Male, 76.2%
Happy 89.7%
Calm 6.6%
Sad 1.2%
Surprised 1%
Disgusted 0.4%
Fear 0.4%
Confused 0.3%
Angry 0.3%

AWS Rekognition

Age 41-49
Gender Male, 99.1%
Happy 80.9%
Surprised 9.4%
Sad 4.1%
Fear 1.5%
Confused 1.4%
Disgusted 1.1%
Calm 0.9%
Angry 0.7%

AWS Rekognition

Age 26-36
Gender Male, 99.6%
Surprised 66%
Calm 18.5%
Angry 4.2%
Fear 3.9%
Sad 2.8%
Disgusted 2%
Happy 1.8%
Confused 0.9%

AWS Rekognition

Age 45-51
Gender Male, 59.1%
Happy 89.1%
Calm 7.1%
Sad 1.5%
Angry 0.8%
Surprised 0.7%
Confused 0.5%
Disgusted 0.3%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Tie
Person 99.5%
Person 99.1%
Person 99%
Person 98.8%
Person 98.3%
Person 98.3%
Person 97.6%
Person 97.2%
Person 96.4%
Person 90.6%
Person 54.1%
Tie 95.3%
Tie 77.3%
Tie 61.1%

Text analysis

Google

MJI7--YT3RA2--Aa
MJI7--YT3RA2--Aa