Human Generated Data

Title

Untitled (large crowd of people waiting to approach store counter, seen from above)
Date

c. 1945
People

Artist: Jack Gould, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.14704

Human Generated Data

Title

Untitled (large crowd of people waiting to approach store counter, seen from above)

People

Artist: Jack Gould, American

Date

c. 1945

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Human 98.8
Person 98.8
Person 97.9
School 96.7
Room 96.7
Classroom 96.7
Indoors 96.7
Chair 95.6
Furniture 95.6
Crowd 95.5
Audience 95.5
Person 91.7
Person 89.7
Person 88.1
Person 84.9
Person 76.9
People 76.8
Person 76.2
Person 76.1
Person 73.7
Person 71.1
Person 68.9
Person 65.9
Table 62.7
Person 61.9
Urban 59.9
Clinic 59.6
Clothing 58.7
Apparel 58.7
Speech 58.5
Seminar 58.5
Lecture 58.5
Workshop 56.9
Food 55.4
Meal 55.4
Waiting Room 55.2
Person 55.1
Person 50
Person 49.1
Person 45.4

Imagga
created on 2022-01-29

wedding 23.9
glass 21.1
celebration 19.1
blackboard 18.7
groom 17.5
bride 16.4
party 16.3
chandelier 16.3
table 15.7
love 14.2
flowers 13.9
decoration 13.4
people 13.4
marriage 13.3
bouquet 13.2
reception 11.7
romantic 11.6
flower 11.5
lighting fixture 11.5
couple 11.3
man 11.2
drink 10.8
romance 10.7
setting 10.6
black 10.2
wed 9.8
decor 9.7
ceremony 9.7
restaurant 9.7
banquet 9.5
day 9.4
business 9.1
texture 9
bridal 8.7
dinner 8.7
fixture 8.6
elegant 8.6
male 8.5
color 8.3
wine 8.3
retro 8.2
happy 8.1
aged 8.1
negative 8.1
suit 8.1
light 8
person 8
surface 7.9
women 7.9
design 7.9
matrimony 7.9
tablecloth 7.8
alcohol 7.7
men 7.7
luxury 7.7
married 7.7
floral 7.6
two 7.6
hand 7.6
crystal 7.5
art 7.4
gold 7.4
event 7.4
clothing 7.3
dress 7.2
interior 7.1
silver 7.1
businessman 7.1
happiness 7
container 7

Google
created on 2022-01-29

Font 82.9
Black-and-white 82
Line 81.7
Art 81.5
Crowd 73.7
Monochrome photography 72.5
Event 72.2
Illustration 70.2
Monochrome 70
Room 67.8
Pattern 67.5
Rectangle 63.1
Audience 57.1
Circle 56.9
Visual arts 54.9
History 53.5
Painting 50.6

Microsoft
created on 2022-01-29

person 98.6
text 98.1
posing 70.1

Face analysis

Amazon

Google

AWS Rekognition

Age 29-39
Gender Male, 99.5%
Calm 72%
Sad 18.8%
Happy 6.5%
Surprised 0.8%
Confused 0.7%
Angry 0.5%
Disgusted 0.5%
Fear 0.2%

AWS Rekognition

Age 35-43
Gender Male, 100%
Calm 83.5%
Sad 4.3%
Surprised 4.1%
Confused 3.7%
Angry 1.7%
Disgusted 1.5%
Happy 0.9%
Fear 0.4%

AWS Rekognition

Age 33-41
Gender Male, 54.7%
Happy 58.2%
Calm 32.8%
Sad 3.8%
Surprised 1.7%
Disgusted 1.5%
Angry 0.9%
Confused 0.7%
Fear 0.4%

AWS Rekognition

Age 16-22
Gender Male, 99.8%
Sad 96.1%
Angry 2%
Calm 1.5%
Confused 0.2%
Disgusted 0.1%
Happy 0.1%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 27-37
Gender Male, 99.9%
Calm 97.5%
Sad 1.6%
Happy 0.5%
Confused 0.2%
Surprised 0.1%
Angry 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 43-51
Gender Male, 85.5%
Calm 57.1%
Happy 26.9%
Sad 10.2%
Confused 2%
Angry 1.3%
Surprised 1.2%
Disgusted 0.9%
Fear 0.3%

AWS Rekognition

Age 38-46
Gender Male, 100%
Sad 54.3%
Calm 27.5%
Fear 4.2%
Confused 3.7%
Happy 3.6%
Disgusted 3.3%
Surprised 1.8%
Angry 1.6%

AWS Rekognition

Age 48-56
Gender Male, 98.5%
Sad 40.8%
Calm 36.8%
Happy 14%
Angry 2.7%
Surprised 2.3%
Confused 2%
Disgusted 0.9%
Fear 0.5%

AWS Rekognition

Age 37-45
Gender Male, 99.8%
Calm 99%
Sad 0.4%
Happy 0.4%
Angry 0.1%
Confused 0%
Surprised 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 39-47
Gender Male, 100%
Happy 65.1%
Calm 25.8%
Sad 3.5%
Confused 1.7%
Surprised 1.5%
Disgusted 1.4%
Angry 0.7%
Fear 0.4%

AWS Rekognition

Age 38-46
Gender Male, 99.8%
Calm 90.8%
Happy 3.8%
Sad 1.6%
Confused 1.2%
Surprised 1.2%
Disgusted 0.7%
Angry 0.5%
Fear 0.2%

AWS Rekognition

Age 37-45
Gender Male, 97.6%
Calm 79.3%
Sad 14.9%
Confused 2.5%
Happy 1.9%
Angry 0.6%
Disgusted 0.4%
Surprised 0.3%
Fear 0.1%

AWS Rekognition

Age 20-28
Gender Male, 99.9%
Calm 83.9%
Confused 9%
Sad 4.6%
Happy 1.6%
Angry 0.3%
Surprised 0.3%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 37-45
Gender Female, 95.7%
Calm 97%
Sad 2.4%
Confused 0.2%
Happy 0.2%
Surprised 0.1%
Angry 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 25-35
Gender Female, 97.5%
Calm 93%
Happy 4.5%
Sad 1%
Confused 0.6%
Angry 0.3%
Fear 0.3%
Disgusted 0.2%
Surprised 0.1%

AWS Rekognition

Age 26-36
Gender Male, 93.8%
Disgusted 25.2%
Confused 21.7%
Calm 20.8%
Surprised 15.5%
Sad 7.2%
Happy 4.5%
Angry 3.3%
Fear 1.8%

AWS Rekognition

Age 24-34
Gender Male, 98.5%
Sad 54.9%
Calm 25.8%
Confused 12.5%
Angry 2.5%
Happy 2%
Disgusted 1.1%
Surprised 0.8%
Fear 0.3%

AWS Rekognition

Age 48-56
Gender Male, 98.5%
Sad 85.5%
Angry 6.6%
Calm 4%
Confused 1.3%
Disgusted 1%
Happy 1%
Surprised 0.4%
Fear 0.4%

AWS Rekognition

Age 26-36
Gender Male, 82.6%
Sad 85.5%
Confused 7.6%
Calm 4.4%
Happy 0.9%
Fear 0.5%
Angry 0.5%
Surprised 0.3%
Disgusted 0.3%

AWS Rekognition

Age 36-44
Gender Female, 96.5%
Calm 86.6%
Happy 3.2%
Sad 2.5%
Surprised 2.1%
Fear 1.9%
Confused 1.5%
Angry 1.1%
Disgusted 1%

AWS Rekognition

Age 45-53
Gender Male, 99.9%
Calm 98.1%
Sad 0.9%
Happy 0.2%
Confused 0.2%
Angry 0.2%
Disgusted 0.2%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 37-45
Gender Female, 100%
Happy 67.8%
Calm 23%
Sad 4%
Confused 2.2%
Surprised 1.4%
Disgusted 1%
Fear 0.4%
Angry 0.4%

AWS Rekognition

Age 42-50
Gender Female, 69.1%
Calm 74.7%
Confused 16.8%
Happy 2.9%
Sad 2.7%
Angry 0.9%
Surprised 0.9%
Disgusted 0.7%
Fear 0.4%

AWS Rekognition

Age 31-41
Gender Male, 55.1%
Calm 96.4%
Happy 1.1%
Sad 1%
Disgusted 0.4%
Surprised 0.4%
Confused 0.3%
Fear 0.1%
Angry 0.1%

AWS Rekognition

Age 18-26
Gender Male, 99.7%
Calm 98.9%
Sad 0.9%
Happy 0.1%
Confused 0.1%
Angry 0%
Surprised 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 25-35
Gender Male, 99.6%
Calm 95%
Angry 1.4%
Surprised 1.1%
Confused 0.9%
Sad 0.9%
Happy 0.4%
Fear 0.3%
Disgusted 0.1%

AWS Rekognition

Age 29-39
Gender Male, 95.9%
Calm 75.5%
Sad 20.1%
Angry 1.5%
Happy 1%
Confused 0.9%
Disgusted 0.5%
Surprised 0.2%
Fear 0.2%

AWS Rekognition

Age 23-33
Gender Male, 93.8%
Calm 59.5%
Sad 22.7%
Confused 8.2%
Surprised 3.4%
Happy 2.5%
Disgusted 1.8%
Angry 1%
Fear 0.7%

AWS Rekognition

Age 25-35
Gender Male, 98.3%
Calm 51.4%
Sad 44.1%
Confused 1.8%
Angry 1.5%
Disgusted 0.6%
Surprised 0.2%
Happy 0.2%
Fear 0.2%

AWS Rekognition

Age 28-38
Gender Male, 86.5%
Calm 85.3%
Sad 6.5%
Happy 3.6%
Confused 1.3%
Surprised 1.1%
Fear 0.8%
Angry 0.7%
Disgusted 0.7%

AWS Rekognition

Age 28-38
Gender Female, 79%
Sad 42.5%
Happy 26.5%
Confused 15.2%
Calm 12%
Disgusted 1.4%
Angry 1%
Surprised 0.8%
Fear 0.6%

AWS Rekognition

Age 36-44
Gender Male, 85.7%
Calm 81.2%
Sad 9.9%
Happy 3.8%
Confused 3.5%
Angry 0.7%
Surprised 0.4%
Disgusted 0.3%
Fear 0.2%

AWS Rekognition

Age 22-30
Gender Female, 95.6%
Happy 42.5%
Sad 26.9%
Calm 16.7%
Fear 4.9%
Confused 4.6%
Surprised 1.8%
Disgusted 1.7%
Angry 0.9%

AWS Rekognition

Age 29-39
Gender Male, 88.5%
Calm 85%
Happy 7.8%
Confused 2.3%
Sad 1.7%
Disgusted 1.1%
Surprised 1%
Angry 0.7%
Fear 0.4%

AWS Rekognition

Age 21-29
Gender Male, 91%
Sad 75.6%
Calm 21.4%
Angry 1.7%
Confused 0.7%
Disgusted 0.4%
Surprised 0.1%
Fear 0.1%
Happy 0.1%

AWS Rekognition

Age 21-29
Gender Female, 99.9%
Calm 70.5%
Happy 17.1%
Sad 7.5%
Confused 1.8%
Angry 1.5%
Fear 0.6%
Surprised 0.5%
Disgusted 0.4%

AWS Rekognition

Age 18-26
Gender Female, 99.7%
Calm 91.8%
Sad 5.3%
Surprised 1.4%
Happy 0.7%
Angry 0.2%
Disgusted 0.2%
Confused 0.2%
Fear 0.1%

AWS Rekognition

Age 28-38
Gender Female, 87.3%
Calm 78.9%
Sad 20.9%
Happy 0.1%
Angry 0.1%
Fear 0%
Confused 0%
Disgusted 0%
Surprised 0%

AWS Rekognition

Age 24-34
Gender Female, 97.8%
Sad 72.9%
Calm 11.6%
Confused 10.4%
Happy 2.8%
Angry 0.9%
Fear 0.7%
Disgusted 0.5%
Surprised 0.3%

AWS Rekognition

Age 20-28
Gender Male, 99.2%
Sad 79.2%
Calm 8.6%
Confused 5.4%
Happy 3.7%
Disgusted 0.9%
Surprised 0.9%
Angry 0.8%
Fear 0.5%

AWS Rekognition

Age 23-33
Gender Female, 99.1%
Calm 69.5%
Happy 16.4%
Sad 5.7%
Confused 3.9%
Angry 1.7%
Surprised 1.1%
Fear 0.9%
Disgusted 0.7%

AWS Rekognition

Age 31-41
Gender Male, 99.7%
Calm 37.4%
Happy 18.5%
Angry 16.2%
Sad 15.8%
Disgusted 4.5%
Confused 3.4%
Surprised 2.4%
Fear 1.8%

AWS Rekognition

Age 21-29
Gender Female, 95.9%
Calm 69.4%
Happy 21.5%
Sad 3.9%
Disgusted 1.9%
Angry 1.3%
Surprised 1%
Fear 0.5%
Confused 0.4%

AWS Rekognition

Age 53-61
Gender Male, 97.4%
Calm 43.8%
Sad 24%
Surprised 19.7%
Happy 4.1%
Confused 2.8%
Disgusted 2.5%
Angry 1.9%
Fear 1.2%

AWS Rekognition

Age 18-26
Gender Female, 93.4%
Calm 35%
Happy 34.8%
Sad 21.1%
Confused 3.1%
Angry 2.3%
Disgusted 1.4%
Surprised 1.3%
Fear 1%

AWS Rekognition

Age 6-14
Gender Male, 58%
Calm 41.7%
Sad 25.1%
Surprised 21.1%
Happy 4.6%
Disgusted 3.9%
Fear 1.8%
Angry 1%
Confused 0.9%

AWS Rekognition

Age 24-34
Gender Male, 91.6%
Sad 96.1%
Calm 2.2%
Angry 0.5%
Confused 0.5%
Disgusted 0.3%
Happy 0.2%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 16-24
Gender Male, 82.6%
Calm 93.4%
Sad 5.1%
Happy 0.5%
Angry 0.3%
Disgusted 0.3%
Confused 0.2%
Fear 0.2%
Surprised 0.1%

AWS Rekognition

Age 23-33
Gender Female, 78.8%
Calm 47.7%
Happy 23.8%
Sad 22.7%
Confused 2.2%
Angry 1.6%
Surprised 0.8%
Disgusted 0.8%
Fear 0.6%

AWS Rekognition

Age 18-26
Gender Female, 94.2%
Happy 75.9%
Calm 14.8%
Sad 3.7%
Fear 2.2%
Surprised 1.1%
Confused 1%
Disgusted 0.8%
Angry 0.4%

AWS Rekognition

Age 25-35
Gender Female, 98.4%
Happy 55.5%
Calm 31.8%
Sad 5.4%
Confused 2.7%
Angry 2%
Disgusted 1%
Fear 0.9%
Surprised 0.7%

AWS Rekognition

Age 45-53
Gender Male, 99.6%
Happy 49%
Confused 22.1%
Sad 13.2%
Surprised 5.3%
Calm 4.3%
Disgusted 3.3%
Angry 2%
Fear 0.6%

AWS Rekognition

Age 27-37
Gender Male, 97.2%
Calm 96.9%
Sad 1.8%
Confused 0.7%
Happy 0.2%
Angry 0.2%
Disgusted 0.1%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 25-35
Gender Male, 99.4%
Sad 42%
Confused 26.7%
Calm 15.1%
Happy 6.9%
Angry 4.7%
Disgusted 2%
Surprised 1.7%
Fear 0.9%

AWS Rekognition

Age 28-38
Gender Male, 99.7%
Sad 50.3%
Happy 21.9%
Calm 19.3%
Fear 4.4%
Angry 1.3%
Disgusted 1.1%
Confused 0.9%
Surprised 0.6%

AWS Rekognition

Age 37-45
Gender Female, 66.2%
Angry 53.3%
Sad 20%
Calm 8.2%
Happy 5.5%
Confused 5.4%
Disgusted 5.2%
Surprised 1.3%
Fear 1.1%

AWS Rekognition

Age 21-29
Gender Female, 99.5%
Calm 27.6%
Fear 26.8%
Surprised 14.3%
Sad 10.5%
Angry 8.2%
Happy 6.4%
Confused 3.4%
Disgusted 2.8%

AWS Rekognition

Age 24-34
Gender Male, 96.8%
Calm 94%
Sad 5.5%
Disgusted 0.1%
Angry 0.1%
Confused 0.1%
Surprised 0.1%
Fear 0%
Happy 0%

AWS Rekognition

Age 11-19
Gender Female, 77.7%
Calm 93.3%
Sad 4.3%
Angry 0.6%
Confused 0.5%
Fear 0.4%
Happy 0.4%
Surprised 0.3%
Disgusted 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.8%

Captions

Microsoft

a group of people standing in front of a crowd posing for the camera 71.9%
a group of people posing for a photo 71.8%
a group of people posing for a photo in front of a crowd 71.7%

Text analysis

Amazon

LAMPS
MJI7
MJI7 ACHA
ACHA

Google

YT3RA
MJIR YT3RA
MJIR