Human Generated Data

Title

Untitled (medium format images of mother posed with three children in living room)

Date

1967

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10085

Human Generated Data

Title

Untitled (medium format images of mother posed with three children in living room)

People

Artist: Martin Schweig, American 20th century

Date

1967

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-28

Human 99.7
Person 99.7
Person 99.4
Person 99.4
Person 99.4
Person 99.3
Person 99.1
Person 98.2
Clothing 97.2
Apparel 97.2
Person 93.2
Advertisement 86.7
Collage 86.7
Poster 86.7
Head 80.6
Accessories 79.6
Accessory 79.6
Tie 79.6
Face 69.3
Coat 66.4
People 64.8
Sitting 63
Overcoat 61.5
Suit 59
Sleeve 57

Imagga
created on 2022-01-28

man 43.7
person 38.7
male 34.8
people 34
businessman 30.9
office 30.8
adult 28.5
patient 26.6
business 24.9
professional 24.5
nurse 22.8
happy 22.6
handsome 21.4
portrait 21.4
senior 20.6
groom 20.5
smiling 20.3
bow tie 19.6
job 19.5
businesspeople 19
meeting 18.8
couple 18.3
casual 17.8
executive 17.8
necktie 17.8
mature 17.7
corporate 17.2
sitting 17.2
looking 16.8
home 16.7
case 16.5
clothing 16.4
computer 16
indoors 15.8
happiness 15.7
occupation 15.6
indoor 15.5
sick person 15.5
group 15.3
team 15.2
face 14.9
work 14.9
worker 14.6
men 14.6
lifestyle 14.5
desk 14.4
suit 12.9
smile 12.8
laptop 12.8
mid adult 12.5
old 12.5
holding 12.4
working 12.4
career 12.3
cheerful 12.2
teamwork 12.1
two 11.9
businesswoman 11.8
formal 11.5
specialist 11.3
modern 11.2
manager 11.2
love 11
communication 10.9
family 10.7
color 10.6
elderly 10.5
attractive 10.5
room 10.2
confident 10
businessperson 9.7
interior 9.7
medical 9.7
busy 9.6
together 9.6
black 9.6
leadership 9.6
tie 9.5
expression 9.4
garment 9.4
successful 9.2
alone 9.1
care 9.1
health 9
human 9
technology 8.9
table 8.9
to 8.9
success 8.8
40s 8.8
colleagues 8.7
women 8.7
partner 8.7
1 8.7
day 8.6
talking 8.6
doctor 8.5
shirt 8.4
company 8.4
hand 8.4
house 8.4
jacket 7.9
good looking 7.8
education 7.8
two people 7.8
retired 7.8
employment 7.7
employee 7.4
student 7.2
hair 7.1
hospital 7.1
mother 7.1
medicine 7

Google
created on 2022-01-28

Hairstyle 95.1
Photograph 94.2
White 92.2
Product 90.7
Black 89.8
Fashion 88.5
Black-and-white 85.2
Style 83.8
Font 81.3
Art 77.8
Tie 74.9
Event 74.9
Snapshot 74.3
Monochrome photography 71.7
Eyewear 71.4
T-shirt 66.9
Sitting 65.7
Monochrome 65.7
Fun 65.4
Stock photography 64.8

Microsoft
created on 2022-01-28

person 99.9
wall 96.5
clothing 95.6
man 93.1
indoor 92.3
human face 91.5
text 86.6
smile 83.7
group 58.8
people 55.6

Face analysis

Amazon

Google

AWS Rekognition

Age 27-37
Gender Female, 98.3%
Happy 43.4%
Sad 31.1%
Calm 12.3%
Fear 3.2%
Confused 2.9%
Surprised 2.7%
Angry 2.6%
Disgusted 1.9%

AWS Rekognition

Age 30-40
Gender Male, 99%
Happy 99.8%
Surprised 0.1%
Sad 0%
Fear 0%
Angry 0%
Disgusted 0%
Calm 0%
Confused 0%

AWS Rekognition

Age 40-48
Gender Female, 98.5%
Happy 93.5%
Sad 4.5%
Calm 0.6%
Surprised 0.4%
Disgusted 0.3%
Fear 0.2%
Angry 0.2%
Confused 0.2%

AWS Rekognition

Age 48-54
Gender Male, 98.3%
Happy 63.3%
Sad 28.6%
Fear 2.5%
Calm 2.1%
Surprised 1.4%
Angry 0.8%
Confused 0.7%
Disgusted 0.6%

AWS Rekognition

Age 54-64
Gender Male, 100%
Happy 70.1%
Sad 15.8%
Confused 6%
Disgusted 4.9%
Surprised 0.8%
Fear 0.8%
Angry 0.8%
Calm 0.8%

AWS Rekognition

Age 38-46
Gender Male, 70.4%
Happy 99%
Sad 0.3%
Surprised 0.2%
Fear 0.2%
Disgusted 0.1%
Angry 0.1%
Confused 0.1%
Calm 0.1%

AWS Rekognition

Age 38-46
Gender Male, 99.3%
Happy 97.4%
Sad 2.1%
Angry 0.1%
Calm 0.1%
Disgusted 0.1%
Fear 0.1%
Surprised 0%
Confused 0%

AWS Rekognition

Age 21-29
Gender Male, 85%
Happy 51.1%
Fear 24.5%
Calm 8.1%
Surprised 6.5%
Sad 4.1%
Angry 2.6%
Disgusted 2.3%
Confused 0.9%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Tie 79.6%

Captions

Microsoft

a group of people posing for the camera 97%
a group of people posing for a photo 95.8%
a group of people posing for a picture 95.7%

Text analysis

Amazon

MAGOM
A*2
MJTRY - 37 A* MAGOM
-137 A*2 KAQOK
A*
- 37
-137
KAQOK
MJTRY